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OPINION 


THE  HIDDEN  IMPLICATIONS 
OF  FORCE  CHANGES 

Dr.  Rolf  Clark 


National  security  planners  naturally  draw  on  insights  and  experiences  when 
making  decisions.  Past  examples,  national  doctrine,  organizational  realities, 
threat  development,  technical  knowledge,  and  fiscal  analysis  are  used.  This 
article  explores  another  useful  insight,  one  on  the  dynamics  of  system  change. 
The  system  of  interest  concerns  force  levels.  An  increase  or  a  decrease  in 
force  levels  can  lead  to  production  dynamics  that  are  unforeseen,  and  sometimes 
even  impossible  to  meet.  During  the  buildup  of  the  1980s,  for  example,  the 
intention  to  achieve  a  600-ship  Navy,  and  related  increases  in  aircraft  forces, 
led  to  procurement  levels  that  were  ultimately  unattainable  within  the  budgets 
available.  Industry  could  not  accelerate  production  levels  enough  to  meet  force 
level  increases  largely  because  unit  costs  rose  dramatically  as  demand  stressed 
supply.  The  intent  is  to  see  why  such  production  difficulties  arise.  The  theory 
will  present  two  important  concepts  in  dynamic  thinking. The  first  concerns  the 
“accelerator,”  a  concept  which  leads  to  instability:  to  bottlenecks  and  excesses. 
The  second  involves  the  distinction  between  “stocks”  and  “flows.”  Stocks  and 
flows  explain  why  accelerators  occur.  These  concepts  are  not  completely 
intuitive. 


We  see  accelerators  in  almost  ev¬ 
ery  aspect  of  life.  They  apply  to 
driving  a  car,  to  inventory  con¬ 
trol,  and  to  the  acquisition  of  forces.  Each 
experiences  system  dynamics.  These 
short-term  “transient  state”  dynamics  oc¬ 
cur  when  a  system  is  changed  from  one 
state  to  another — when  force  levels  are 
raised  as  they  were  in  the  1980s,  or  re¬ 
duced  as  they  have  been  in  the  1990s. 


Further,  stocks  and  flows  are  the  building 
blocks  for  understanding  systems  in 
change. 

The  “first-order  effects”  of  system 
changes  require  crude  examples,  and  cer¬ 
tainly  adjustments  would  be  made  in  real 
life  that  smooth  out  the  first-order  changes. 
Yet  first-order  effects  by  definition  domi¬ 
nate  system  change.  Foreseeing  the  dy¬ 
namics  helps  us  plan  force  changes. 


BEKS  QOMSTST  E 


EDA 
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The  Accelerator:  Driving  Your  Car 

The  accelerator  principle  is  at  work 
when  you  drive  your  car.  Say  you’re  do¬ 
ing  50  mph  on  a  straightaway  and  want  to 
accelerate  to  60.  You  first  step  on  the  gas 
firmly,  and  as  you  reach  60  mph,  ease  back 
to  steady  up.  To  increase  speed  by  20  per¬ 
cent  you  may  increase  the  flow  of  fuel  by 
300  percent  (depending  on  how  fast  you 
accelerate)  and  then  at  60 — the  new  steady 
state — use  only  slightly  more  fuel  than 
you  first  did  at  50  mph.  Speed  only  rises, 
but  fuel  flow  goes  up  and  down. 

While  speeding  up — in  the  “transient 
state” — the  fuel  flow  changes  much  more 
than  the  velocity  of  the  car.  That’s  an  ac¬ 
celerator.  The  same  principle  applies  to 
acquisition:  force  levels  rise,  but  procure¬ 
ment  goes  up  and  then  down. 


Stocks  and  Flows 


Procurement  is  a  flow;  the  force  level 
is  a  stock.  Flows  change  faster  than  stocks. 
That’s  the  accelerator  relationship  again. 

Accelerators  depend  on  the  relationship 
between  a  system’s  stocks  and  its  flows. 
A  stock  is  an  accumulation — an  inventory, 
a  summation,  something  that  has  been  col¬ 
lected  over  time.  It  is  measured  in  units 
like  “aircraft,”  or  “tons,”  or  “boxcars.”  The 
water  in  a  bathtub  (gallons)  is  a  stock.  The 


inventory  of  cars  at  a  Chevrolet  dealer  is 
a  stock. 

Flows,  on  the  other  hand,  are  measured 
in  units  like  “aircraft  per  year,”  or  “tons 
per  week,”  or  “boxcars  per  day.”  Flows 
feed  into  and  out  of  stocks.  The  water 
pouring  through  the  faucet  (gallons  per 
minute)  is  an  inflow;  leaving  through  the 
drain,  an  outflow.  New  cars  arriving  at  the 
dealer  per  week  is  an  inflow;  car  sales  per 
week,  an  outflow.  Stocks  have  value  at  a 
point  in  time;  flows  only  have  value  over 
a  time  interval.  One  can  take  a  still  photo¬ 
graph  of  a  stock;  but  a  seeing  a  flow  re¬ 
quires  a  video  recording. 

In  national  finance,  a  stock  would  be 
the  federal  debt  while  a  flow  would  be  the 
annual  federal  deficit.  Plant  and  equipment 
in  a  corporation  would  be  a  stock  while 
investment  and  depreciation  would  be 
flows.  Stocks  are  on  a  firm’s  balance  sheet; 
they  are  assets  and  liabilities.  Rows  are 
on  the  income  statement;  they  are  the  an¬ 
nual  revenues  and  expenditures. 

In  national  defense,  flows  are  system 
deliveries,  personnel  recruitments,  pur¬ 
chases  of  spare  parts,  shipments  to  and 
from  inventories,  and  force  inactivations. 
Stocks  are  force  levels,  personnel,  inven¬ 
tories,  systems  in  process  of  being  pro¬ 
duced,  and  systems  in  repair.  The  interac¬ 
tions  between  stocks  and  flows  lead  to 
temporary  inventory  shortages,  delivery 
delays,  force  inadequacies,  and  pipeline 
instabilities. 


Dr.  Rolf  Clark  is  a  professor  of  economics  at  the  National  Defense  University’s  Industrial  Col¬ 
lege  of  the  Armed  Forces.  He  received  his  Ph.D.  degree  in  managerial  economics  from  the 
University  of  Massachusetts,  his  M.S.  degree  from  the  Naval  Postgraduate  School,  and  his  B.S. 
degree  from  Yale.  He  teaches  systems  courses  as  an  adjunct  professor  at  The  George  Washing¬ 
ton  University.  Earlier,  he  served  as  a  line  officer  in  the  U.S.  Navy. 
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Logical  Implications 


Stocks  and  Flows  Are  Pervasive 


All  systems  can  be  modeled  in  terms 
of  stocks  and  flows.  Modeling  systems 
using  stocks  and  flows  is  an  aspect  of  sys¬ 
tem  simulation,  and  of  “system  dynam¬ 
ics”  in  particular.  We  cannot  treat  the  dis¬ 
cipline  in  detail  here  (see  Forrester,  1968), 
but  even  with  a  simple  system,  several 
factors  can  be  acknowledged. 

If  system  stocks  last  a  very  long  time, 
then  the  flows  that  maintain  them  will  be 
small.  If  assets  have  a  30-year  life,  like 
Navy  ships,  in  peacetime  only  about  1/ 
30th  of  them  leave  each  year  and  thus  only 
l/30th  of  them  need  to  be  replaced. 

As  a  corollary,  if  the  flows  are  small 
compared  to  the  stock,  then  the  stock 
changes  slowly.  The  small  flows  mean 
long-lived  force  assets  require  lengthy 
periods  of  time  to  evolve  into  new  con¬ 
figurations.  The  steady  state  in  shipbuild¬ 
ing  occurs  about  50  years  after  a  change, 
when  the  fleet  has  finally  turned  over. 

Consider  national  investment.  If  na¬ 
tional  savings  per  year  (a  flow)  is  low,  we 
will  invest  less  and  the  economy  cannot 
change  rapidly.  Countries  like  Japan  and 
Korea,  with  much  higher  savings  rates 
than  the  United  States  during  the  1970s 
and  1980s,  were  able  to  shift  their  econo¬ 
mies  to  new  technologies  far  faster. 

The  dynamics  are  different  for  shorter 
lived  systems.  Information  age  systems 
like  electronics  and  software  reach  obso¬ 
lescence  after  four  or  five  years,  and  have 
faster  turnover  rates.  They  consequently 
experience  less  severe  transient  dynam¬ 
ics,  though  they  cost  more  to  sustain  at 
required  levels. 


Stocks  and  flows  and  their  associated 
accelerators  are  everywhere.  Fortunes  are 
made  or  lost  because  of  them. 

In  1970  there  was  a  com  blight,  and 
prices  increased  dramatically.  Some  trad¬ 
ers  bought  pork  futures,  thinking  they 
would  profit  when  the  price  of  pork  rose. 
Pigs  are  corn-fed  and  a  rise  in  com  prices 
would  mean  pork  prices  should  also  rise. 
This  is  indeed  true  in  steady  state,  but  not 
in  the  short-term  transient  state.  In  fact, 
pork  dropped  in  price  for  six  months  after 
com  prices  rose.  Why?  Pig  farmers,  know¬ 
ing  they  could  not  afford  the  higher  feed 
prices,  slaughtered  their  breeding  stock, 
causing  an  accelerated  short-term  flow  of 
pork  to  the  marketplace.  The  flow  caused 
a  glut,  and  instead  of  pork  prices  rising, 
they  fell.  A  year  | 
later  pork  was  j 
indeed  at  far 
higher  prices, 
but  in  the  in¬ 
terim  the  traders  i 


"Stocks  and  flows 
and  their  associated 
accelerators  are 
everywhere*’  Fer»:ej| 
,,  ,  tunes  can  be  made 

iad  lost  heavily  or  |ost  because  ef 
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1970). 

In  the  mid- 

1970s,  long  before  the  oil  price  reached 
ts  1980  peak,  a  graduate  student  at  the 
Vlassachusetts  Institute  of  Technology  re¬ 
portedly  advised  his  family — who  owned 
pil  tankers — to  sell  their  fleet.  He  had  ob¬ 
served  that  the  flow  of  tankers  in  produc- 
;ion  was  too  large  compared  to  the  stock 
pf  existing  tankers,  and  there  would  soon 
be  excess  tankers  at  sea.  He  was  right.  The 
utilization  rate  of  the  world’s  tankers  fell 
from  120  percent  in  1972  to  70  percent  in 
1979  to  40  percent  in  1982.  This  lowered 
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the  value  of  tankers,  which  soon  were  sell¬ 
ing  at  far  less  than  their  building  cost.  The 
family  reentered  the  market  at  its  bottom, 
and  by  1989  the  utilization  rate  was  again 
near  90%  (Randers,  1984;  Bakken,  1992). 

Surge  Dynamics 


We  have  argued  that  if  the  stock  of  as¬ 
sets  is  to  be  increased  rapidly — as  in  mo¬ 
bilization  or  even  surge — then  the  pro¬ 
curement  inflow  must  increase  dramati¬ 
cally.  It  is  time  to  explore  the  accelerator 
and  its  dynamics  more  quantitatively. 
Consider  Figure  1. 

Suppose  you  want  to  increase  an  air¬ 
craft  fleet  from  80  to  1 00  in  five  years  and 
that  aircraft  last  10  years.  The  eventual 
100-aircraft  force  will  then  have  l/10th, 
or  10  of  the  aircraft  retiring  each  year.  To 
stay  at  100  aircraft,  10  units  need  to  be 
procured  each  year  to  replace  those  retir¬ 


ing.  The  original  80  aircraft  fleet  required 
only  8  be  built  each  year.  But  it  is  mis¬ 
leading  to  conclude  that  to  go  from  a  force 
of  80  to  100  means  raising  aircraft  pro¬ 
duction  from  8  to  10.  Such  steady-state 
thinking  is  incomplete.  To  raise  the 
stock  of  aircraft  from  80  to  100  requires 
adding  20  aircraft.  To  do  this  in  five  years 
means  producing  four  extra  aircraft  each 
of  the  five  years,  or  increasing  the  annual 
production  flow  from  8  to  12,  a  50  per¬ 
cent  increase  as  shown.  At  the  end  of  the 
five-year  buildup,  since  none  of  the  20 
new  aircraft  need  replacement,  the  produc¬ 
tion  flow  drops  to  10.  To  increase  the  force 
assets  by  25  percent  over  five  years  means 
the  flow  of  aircraft  being  produced  needs 
to  suddenly  increase  by  50  percent — truly 
a  building  boom.  A  bust  period,  however, 
follows.  This  inevitable  boom-to-bust  dy¬ 
namic  is  the  accelerator  at  work. 

This  simple  analysis  has  ignored  attri¬ 
tion,  which  could  be  accommodated  but 


SURGE  DYNAMICS 


100 


TIME - ► 
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Figure  1.  Surge  Dynamics— Production  of  Assets 
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does  muddy  the  discussion.  In  a  peace¬ 
time  buildup,  attrition  would  not  be  a  fac¬ 
tor.  In  war  it  would  significantly  increase 
the  dynamics  as  first  production  would 
need  to  accelerate  even  more  to  accom¬ 
modate  the  attrited  units.  Then  by  ceasing 
hostilities,  there  would  be  an  even  larger 
drop  as  attrition  ceases  the  same  time  re¬ 
duced  force  levels  are  needed.  Thus  the 
accounting  would  involve  more  arith¬ 
metic,  but  the  concept  would  be  the  same. 

Another  caveat  is  that  the  above  has 
assumed  units  are  only  bought  or  inacti¬ 
vated.  They  might  also  be  updated  through 
modernization.  This  again  complicates  the 
analysis  beyond  the  discussion  intended 
here,  though  modernization  can  also  be  ac¬ 
commodated.  One  wants  a  computer 
simulation  to  do  so.  Equipment  upgrades 
extend  the  life  of  systems,  and  are  a  way 
to  ameliorate  sudden  increases  in  procure¬ 
ment  by  spreading  expenditures  out  over 
time.  One  then  needs  to  maintain  infor¬ 
mation  on  system  age,  and  prepare  for 
eventual  block  obsolescence. 

Furthermore,  adjustments  in  the  analy¬ 
sis  can  be  made  for  the  possibility  of  can¬ 
nibalizing  inactivated  systems.  Cannibal¬ 
izing  means  less  need  for  replacement. 
This  would  reduce  the  accelerated  produc¬ 
tion  during  buildup,  but  the  bust  period 
associated  with  downsizing  would  be  even 
more  severe  as  equipments  would  be 
older,  on  average,  due  to  the  cannibalized 
parts. 

Such  qualifiers  provide  the  second-  and 
third-order  considerations.  The  dotted  line 
in  the  above  indicates  there  will  be  ways 
to  smooth  out  the  severity  of  the  first-or¬ 
der  impacts  discussed  so  far,  though  the 
attrition  aspect  actually  amplifies  them. 


The  Attraction  of  Maintenance 

Precisely  because  of  the  severe  dynam¬ 
ics  associated  with  production,  firms  of¬ 
ten  diversify  into  maintenance  of  assets. 
Maintenance  is  closely  related  to  force 
levels,  which  vary  far  less  than  procure¬ 
ments.  If  a  firm — such  as  an  aircraft  en¬ 
gine  manufacturer— can  augment  its  pro¬ 
duction  business  with  maintenance  ser¬ 
vices,  its  financial  fortunes  will  be  more 
stable.  From  automobile  agencies  to  aircraft 
engine  manufacturers  to  shipyards,  mainte¬ 
nance  business  becomes  a  stabilizing  force. 

Upstream  Production  has 
Amplified  Dynamics 


Returning  to  our  simple  example  to  see 
what  more  can  be  drawn  out,  the  50  per¬ 
cent  sudden  increase  in  the  flow  of  pro¬ 
duction,  compared  to  the  25  percent  in¬ 
crease  spread 

over  five  years  „Prec|sely  because 
in  the  stock  of  0|  ||,e  severe  dy- 
assets,  is  a  large  „ami„  associated 
difference.  Pro-  with  production, 
duction  flows  firms  often  diversify 
translate  into  %  into  mointenonce  of 
jobs  and  raw  assets*" 
materials.  The  ■ 
first  point,  then, 

is  that  even  small  and  gradual  increases 
in  force  levels  will  mean  large  sudden  in¬ 
creases  in  jobs  and  materials. 

There  is  more.  Upstream  production — 
that  further  up  the  manufacturing  pro¬ 
cess — will  experience  even  greater  dy¬ 
namics.  Consider  the  Figure  2,  which  ex¬ 
pands  Figure  1. 
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SURGE  DYNAMICS 

100 


Figure  2.  Surge  Dynamics— Upstream  Production 


Suppose  that  it  takes  on  average  10  pro¬ 
duction  “machines”  (metal  benders,  cut¬ 
ters,  lathes,  welders,  computers,  etc.)  to 
produce  one  aircraft  per  year.  Then  a  fac¬ 
tory  needs  80  machines  to  produce  eight 
aircraft  per  year.  If  these  “machines”  also 
last  10  years  on  average,  then  eight  ma¬ 
chines  need  to  be  procured  by  the  factory 
each  year  to  replace  those  machines  wear¬ 
ing  out.  During  the  buildup,  however,  pro¬ 
duction  is  raised  to  12  aircraft  per  year, 
and  thus  about  120  machines  are  needed. 
To  get  from  80  to  120  machines  in  five 
years  the  factory  must  buy  1 6  machines 
per  year  for  five  years — eight  to  replace 
those  ending  their  useful  life  plus  another 
eight  each  year  for  five  years  to  get  40 
more  machines.  While  aircraft  assets  have 
increased  25  percent  and  aircraft  produc¬ 
tion  50  percent,  machine  production  must 
increase  100  percent,  from  8  to  16.  After 
reaching  the  desired  level  of  machines, 


machine  tool  production  experiences  a 
bust  period,  followed  by  a  recovery  when 
steady  state  is  finally  reached.  Upstream 
production  dynamics  are  severe. 

Machine  tools  are  further  up  the  pro¬ 
duction  stream,  as  they  produce  the  ma¬ 
chines  that  produce  the  assets.  In  1945,  J. 
A.  Krug,  then  Chairman  of  the  War  Pro¬ 
duction  Board,  reported  on  the  criticality 
of  machine  tools  during  the  World  War  II: 
“The  timing  varied  for  different  products 
and  different  industries,  but  in  general  the 
acute  shortage  as  the  defense  effort  first 
got  underway  was  in  the  facilities. . .  plant, 
equipment,  and  above  all,  machine  tools” 
(War  Production  Board,  1945). 

Capital  equipment  sectors  continue  to 
experience  wide  swings.  Between  1981 
and  1983  the  U.S.  machine  tool  sector  lost 
60  percent  of  its  annual  new  orders  (AMT, 
1992-93).  Machine  tools  are  only  one 
example  of  the  upstream  production  fac- 
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tors.  Plant  and  equipment,  commercial  real 
estate,  as  well  as  factories,  mills,  and  refin¬ 
eries,  also  are  driven  by  such  dynamics. 

Clearly,  planners  will  want  to  anticipate 
such  impacts  on  the  industrial  base  when 
force  level  changes  are  planned. 

Long-  Versus  Short-Lived  Assets 


Ships  and  oil  equipment  and  real  estate 
have  long  lives.  Industries  producing 
goods  with  shorter  life  spans,  like  elec¬ 
tronic  equipment,  will  experience  less  se¬ 
vere  production  dynamics.  Since  they  de¬ 
cay  more  rapidly,  their  flows  are  relatively 
large  compared  to  their  stocks.  They  “turn 
over”  faster.  As  a  result  their  production 
booms  and  busts  are  more  contracted  in 
time,  and  less  severe  in  amplitude. 

Let’s  translate  the  above  80  to  100  air¬ 
craft  example  into  an  analogous  $80  mil¬ 
lion  to  $100  million  electronic  system.  If 
the  electronic  components  last  only  five 
years,  the  $80  million  program  will  require 
20  percent  of  its  value,  or  $16  million  of 
procurement  per  year,  to  retain  its  origi¬ 
nal  value.  Increasing  the  system’s  value 
to  $100  million  in  five  years  means  in¬ 
creasing  procurement  budgets  by  $4  mil¬ 
lion  per  year — from  $16  million  to  $20 
million — a  25  percent  increase.  Thus 
while  aircraft  that  lasted  10  years  required 
a  50  percent  increase  in  procurement  to 
raise  assets  by  20  percent,  the  electronic 
system  with  assets  lasting  only  five  years 
required  only  a  25  percent  increase  in  pro¬ 
curement  to  obtain  the  same  proportional 
growth  in  the  same  time.  Systems  with 
shorter  life  spans  require  less  severe  dy¬ 


namics  during  change.  The  information 
age,  with  shorter  system  lives  as  well  as 
more  agile  production,  may  experience 
less  severe  system  dynamics. 


A  Word  on  Budgets 


We  have  seen  that  procurement,  and 
therefore  procurement  budgets,  change 
dramatically  when  force  levels  change. 
Operations  and  maintenance  (O&M)  bud¬ 
gets  and  personnel  budgets,  on  the  other 
hand,  do  not  experience  the  same  dynam¬ 
ics.  They  are  closely  related  to  force  as¬ 
sets,  and  change  primarily  as  force  levels 
change.  Since  / 

1974  the  de-  «Unljerstanciing 

fense  procure-  dynamics 

ment  budget  has  .  a|,ould  help  improve 
varied  by  an  av-  budget  develop- 
erage  of  12  per- :  ment,  especially 
cent  in  year-to- regarding  the  long- 
year  changes,  term  needs  for 
The  overall  ownership  budgets 
budget  itself  has  assodoted  with  the 
varied  year  by  ,OKe  ,eve,s* 
year  by  only 

five  percent.  The  changes  to  O&M  and 
personnel  budgets,  making  up  most  of  the 
residual  after  procurement,  is  deducted 
from  the  budget,  and  must  logically  vary 
much  less.  The  average  annual  change  of 
ownership  budgets  has  been  between  one 
and  two  percent.1 

Understanding  system  dynamics  should 
help  improve  budget  development,  espe¬ 
cially  regarding  the  long-term  needs  for 
ownership  budgets  associated  with  the 
force  levels. 


1  Some  care  must  be  taken  in  thinking  about  this.  Planned  O&M  budgets  often  swing  widely,  but  executed 
O&M  budgets  do  not,  for  they  ultimately  support  force  assets,  and  assets  do  not  change  rapidly. 
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Defense  Builddowns  and  Decelerators 


Opposite  dynamics  from  the  above  are 
at  work  during  force  level  reductions.  Pro¬ 
curement  falls  far  more  than  force  levels. 
For  example,  by  1993  military  aircraft 
assets  had  decreased  about  30  percent 
from  1989  levels.  Yet  the  military  engine 
sales  of  U.S.  engine  producers  had  de¬ 
creased  70  percent.2 

This  is  logical.  Just  as  you  ease  up  on 
the  gas  to  slow  down  your  car,  and  then 
increase  gas  flow  again  once  you  reach 
your  desired  lower  speed,  so  aircraft  en¬ 
gine  sales  must  drop  dramatically,  and 
then  rebound  somewhat,  once  the  military 
stabilizes  at  lower  force.  Then,  analogous 

to  the  force  in- 

"More  recently,  crease  dynam- 

decelerators  have  *cs>  production 

forced  reductions  in  wil1  partly  re- 

defense  facilities  bound  as  the 

and  fobs*  The  argu-  new  steady  state 

men*  here  is  that  the  is  reached.  This 

dynamics  are  pre-  rebound  should 

dictable"  be  anticipated. 

For  example, 
the  backlog  of  orders  for  military  aircraft 
engines  actually  rose  in  1995,  after  drop¬ 
ping  steadily  for  the  previous  six  years  as 
aircraft  inventories  fell.  Aircraft  levels 
themselves  did  not  increase  in  1995,  but 
they  stopped  their  rapid  decline.  This  rela¬ 
tive  stabilization  led  to  the  increase  in 
backlog  (AIAA,  1996-97). 


What  is  Needed 


Understanding  acquisition  and  logistics 
dynamics  requires  stock  and  flow  think¬ 


ing.  The  above  samples  are  simplified,  and 
more  complex  problems  need  consider¬ 
ation.  Yet  the  stock-flow  logic  and  what  it 
tells  us  needs  its  place  in  the  policy  mak¬ 
ers’  set  of  analytic  tools.  Such  consider¬ 
ations  will  help  managers  see  that  inven¬ 
tories  in  the  spare  parts  pipeline  will  of¬ 
ten  be  far  from  intended  levels — some¬ 
times  too  high,  sometimes  far  too  low. 
Deliveries  suffer,  lead  times  expand,  and 
prices  rise.  In  the  1980s  buildup,  lead 
times  on  many  items  soared,  and  unit 
prices  rose  dramatically  with  the  surge. 
More  recently,  decelerators  have  forced 
reductions  in  defense  facilities  and  jobs. 
The  argument  here  is  that  the  dynamics 
are  predictable. 

A  more  subtle  insight  is  embedded  in 
the  accelerator-decelerator  paradigm.  An 
initial  cutback  in  force  levels  leads  to  a 
reduction  in  production  as  we  have  seen, 
which  leads  to  a  cutback  in  orders  for  pro¬ 
duction  equipment  (machine  tools)  as  we 
have  also  seen.  But  if  this  production  ca¬ 
pacity  cutback  is  done  without  looking 
ahead  to  the  recovery  phase  of  the  decel- 
erator,  then  there  will  not  be  enough  pro¬ 
duction  capacity  to  recover  when  needed. 
In  the  aircraft  example,  when  production 
stabilizes,  there  may  not  be  enough  ma¬ 
chine  tools  to  produce  the  new  demand 
and  machines  must  first  be  used  to  pro¬ 
duce  more  machines.  This  “bootstrap” 
problem  is  endemic  to  accelerators. 

Nobel  prize  winner  Herbert  Simon’s 
claim  in  the  1 950s  that  the  human  mind 
cannot  solve  the  complex  problems  of  the 
real  world  is  less  true  today.  His  principle 
of  “bounded  rationality”  still  holds,  but  we 
can  do  far  more  exploration  with  comput¬ 
ers  than  we  could  with  the  mathematics 


2  Data  provided  by  Aerospace  Industries  Association,  Washington,  DC. 
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of  1957  (Simon,  1957).  System  dynamics 
such  as  discussed  here  are  now  easily 
modeled  and  should  be  implemented.  This 
would  require  a  reasonable  simulation  ef¬ 
fort  the  captures  the  necessary  intricacies 
of  force  level  procurement  and  support. 

For  now,  incorporating  the  accelerator 
logic  in  policy  thinking  is  beneficial.  Com¬ 
puter  simulations  that  quantify  the  inter¬ 


relationships  between  systems  and  deter¬ 
mine  the  magnitudes  and  timing  of  these 
dynamics  will  naturally  follow.  The  mod¬ 
eling  mathematics  are  state  of  the  art.  The 
policy  implications  are  important.  Plan¬ 
ners  need  to  ensure  that  transient  state 
dynamics  are  adequately  captured  in  the 
policy  making  process. 
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OPINION 


SOME  NEW  APPROACHES  TO 
"REWARD"  CONTRACTING 

William  N.  Washington 


This  article  looks  at  some  new  ideas  on  “Reward”  contracts,  and  how  some 
older  ones  might  be  modified  to  improve  their  usability.  Specifically,  it  deals 
with  three  different  contract  vehicles  for  rewarding  a  contractor’s  performance 
enhancement,  cost  savings,  or  schedule  savings  that  exceed  the  minimum 
requirements  specified  by  the  government.  The  purpose  behind  reward 
contracting  is  to  offer  an  inducement  to  the  contractors  to  go  beyond  business- 
as-usual  development  programs,  and  attempt  to  produce  innovative  processes 
or  products  that  subsequently  benefit  the  government.  This  is  in  keeping  with 
some  suggestions  made  by  former  Under  Secretary  of  Defense  for  Acquisition 
and  Technology  Dr.  Paul  Kaminski  and  Colleen  Preston,  former  Deputy  Under 
Secretary  of  Defense  for  Acquisition  Reform,  concerning  incentivizing  change 
away  from  the  one-size-fits-all  mode  of  contracting,  and  providing  more 
information  to  the  source  selection  authority  for  cost  tradeoffs.  I  discuss  three 
types  of  reward  contracts  (i.e.,  incentive,  award  fee,  and  research  tournaments), 
and  suggest  what  might  be  done  to  improve  them.  An  approach  to  provide 
more  contract  vehicles  for  consideration  in  the  contracting  process,  called 
“research  tournaments,”  seems  to  have  merit. 


In  January  of  1995,  Dr.  Paul  Kaminski, 
then  Under  Secretary  of  Defense  for 
Acquisition  and  Technology,  dis¬ 
cussed  his  concept  of  the  challenges  to  be 
faced  with  decreasing  defense  budgets, 
and  the  need  to  reduce  the  cost  of  weapon 
system  procurements  at  the  Industrial 
College  of  the  Armed  Forces.  He  empha¬ 
sized  the  need  to  adopt  a  more  balanced 
approach  to  the  cost-performance  relation¬ 
ships  in  our  procurements,  stressing  the 


need  to  do  up-front  tradeoffs,  and  assess¬ 
ments  of  the  incremental  cost  require¬ 
ments.  He  stated  that  the  results  of  these 
analyses  should  be  made  available  to  the 
decision  makers  early  in  the  source  selec¬ 
tion  process,  so  they  could  take  them  into 
consideration.  He  also  mentioned  the  need 
to  incentivize  change  away  from  the  one- 
size-fits-all  mode  that  we  have  followed 
in  the  past.  Colleen  Preston  (1995),  former 
Deputy  Under  Secretary  of  Defense  for 
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Acquisition  Reform,  also  stressed  these 
points  in  her  testimony  before  the  House 
Government  Reform  and  Oversight  Com¬ 
mittee. 

Here  I’ll  discuss  some  of  the  new  ideas 
on  competition,  and  how  some  older  ones 
might  be  modified  to  improve  their  use¬ 
fulness.  Specifically,  I’ll  explain  three 
contract  vehicles  for  rewarding  a 
contractor’s  performance  enhancement, 
cost  savings,  or  schedule  savings  that  ex¬ 
ceed  the  minimum  requirements  specified 
by  the  government.  This  is  in  keeping  with 
the  new  Department  of  Defense  (DoD)  Di¬ 
rective  5000.2-R  (1996),  which  stresses 
cost  management  incentives. 

The  purpose  behind  “reward”  contract¬ 
ing  is  to  offer  an  inducement  to  contrac¬ 
tors  to  go  beyond  business-as-usual  de¬ 
velopment  programs,  and  attempt  to  pro¬ 
duce  innovative  processes  or  products  that 
subsequently  benefit  the  government 
(Rogerson,  1989).  This  is  based  upon  the 
premise  that  if  the  reward  to  the  manufac¬ 
turer  is  low,  quality  manufacturers  will  not 
be  interested  in  doing  business  with  the 
government.  For  instance,  if  profits  are 
limited  to  10  percent  of  the  contract  award, 
only  contractors  who  normally  make  less 
or  equal  to  that  in  the  private  sector  will 
be  willing  to  bid  on  the  contract;  contrac¬ 
tors  who  normally  make  more  will  not  be 
willing  to  bid  and  subsequently  lose 
money  by  accepting  those  contracts 
(Lucas,  1996).  Confirmation  of  this  trend 
is  shown  by  the  recent  sale  by  several  con¬ 


tractors  of  their  government  divisions,  so 
they  can  focus  on  the  more  lucrative  com¬ 
mercial  market  (Beltramo,  1996).  In  sup¬ 
port  of  the  reward  premise,  recent  indus¬ 
try  comments  have  suggested  that  the  gov¬ 
ernment  share  some  of  its  savings  with 
industry,  when  industry  has  made  an  in¬ 
vestment  that  produced  savings  for  the 
government  ( National  Defense ,  1996). 

History  of  "Reward7'  Contracting 
Incentive  Contracting 

Under  this  type  of  contract,  the  incen¬ 
tive  payment  varies  based  upon  the 
contractor’s  ability  to  satisfy  specific  for¬ 
mula-driven  cost  or  performance  objec¬ 
tives.  A  precise  definition  of  the  factors 
that  will  be  used  to  determine  the  incen¬ 
tive  fee  to  be  paid  is  negotiated  in  advance, 
and  allows  some  of  the  profit  loss  or  gain 
to  be  shared  between  the  government  and 
the  contractor,  based  on  the  contractor’s 
ability  to  reach  the  target  goal.  The  objec¬ 
tive  of  an  incentive  contract  is  to  moti¬ 
vate  the  contractor  to  earn  more  compen¬ 
sation  by  achieving  better  performance 
and  by  controlling  costs. 

Problems  with  incentive  contracting. 
These  contracts  have  not  been  found  to 
be  especially  effective  in  reducing  costs, 
nor  speeding  up  schedule,  but  they  do  gen¬ 
erally  meet  performance  goals,  according 
to  DeMong  (1984),  who  reviewed  several 
previous  studies  (Belden,  1969;  DeMong, 
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1978;  Hunt,  1971;  Hunt,  Rubin  and 
Perry,  1971;  Jameson,  1979;  and  Williams 
and  Carr,  1981).  The  GAO  (1987)  per¬ 
formed  a  review  of  62  DoD  incentive  con¬ 
tracts  to  determine  if  this  type  of  contract¬ 
ing  met  the  theory  concepts  it  was  sup¬ 
posed  to  follow.  Their  findings  were  con¬ 
sistent  with  the  theory  that  the  final  costs 
for  the  programs  would  fall  around  the 
target  price  set  at  contract  award  (the  ma¬ 
jority  of  the  contracts  fell  within  5  per¬ 
cent  of  the  target),  with  47  percent  of  the 
contracts  falling  under  the  target  and  53 
percent  falling  over  the  target  price.  How¬ 
ever,  21  percent  of  the  contracts  exceeded 
the  ceiling  price  where  the  government 
liability  ended.  They  also  found  that  there 
was  no  relationship  between  the  cost-shar¬ 
ing  ratio  and  the  achievement  of  a 
contract’s  target  price,  which  runs  against 
the  theory  that  as  a  contractor’s  share  ra¬ 
tio  increases,  the  contractor  has  a  greater 
incentive  to  meet  or  underrun  the  target 
costs. 

Award  Fie  Contracting 

In  this  type  of  contract,  the  government 
assigns  priority  to  what  kinds  of  things  it 
considers  important  and  will  pay  an  award 
fee  for.  These  types  of  contracts  have  been 
in  use  since  1 962,  when  the  National  Aero¬ 
nautics  and  Space  Administration  and  the 
Navy  began  to  use  them.  Its  purpose  is  to 
encourage  the  contractor  to  surpass  the 
minimum  acceptable  level  of  performance 
established  in  the  contract,  for  areas  rang¬ 
ing  from  cost  to  schedule  to  performance. 
This  type  of  contract  varies  from  the  in¬ 
centive  contract,  in  that  the  award  is  sub¬ 
jective  and  based  upon  after-the-fact 
evaluations  to  determine  the  amount  of  the 
award.  Award  fee  contracts  have  gener¬ 


ally  been  found  effective  in  improving 
contractor  performance,  according  to 
Beeckler  and  Correia  (1982),  and  DeMong 
(1984),  who  reviewed  a  number  of  previ¬ 
ous  studies  (Brown,  1976;  Buck,  1974; 
Byers,  1973;  Carter,  1977;  DeJong,  1978; 
Egan,  1968;  Hunt,  1982;  Knepshield, 


"Award  fee  contracts 
have  generally  been 
found  effective  in 
improving  contractor 
performance.**/' 


1976;  Larsen,  1978;  and  Williams  and 
Carr,  1981). 

Several  authors 
attribute  the 
success  of  this 
type  of  contract 
over  incentive 
contracts  to  the 
involvement 
and  periodic 

performance  evaluations  performed  on  the 
contracts  (Jameson,  1979;  Keathley, 
1994).  Originally,  this  type  of  contract  was 
limited  to  cost  plus  contracts,  but  Francom 
(1989)  recommended  that  they  should  be 
expanded  to  include  fixed  price  contracts, 
which  they  currently  have  been. 

Problems  with  award  fee  contracting. 
This  type  of  contract  requires  significant 
technical  and  managerial  oversight  to  con¬ 
tinually  monitor  and  communicate  with 
the  contractor  about  their  work  effort, 
since  the  awards  are  made  as  often  as  the 
government  wants  throughout  the 
contract’s  life  (DeMong,  1984; 
Hogenmiller,  1992;  Schade,  1990).  A 
problem  may  also  exist  with  the  determi¬ 
nation  of  the  contractor’s  performance,  be¬ 
cause  of  the  subjective  nature  of  the  deci¬ 
sion  process  that  determines  the  amount 
of  the  award  fee  (GAO  Study,  1991 ;  Isbell, 
1992).  This  GAO  review  of  the  Depart¬ 
ment  of  Energy  Award  Contracts  (1991) 
recommended  improvement  in  three  ar¬ 
eas.  The  first  was  to  develop  specific,  mea- 
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surable  performance  objectives  to  sup¬ 
plant  what  had  been  used  previously.  Sec¬ 
ond  was  to  develop  procedures  that  ap¬ 
propriately  reflected  the  results  of  the  on¬ 
site  reviews  in  the  performance  evalua¬ 
tions,  and  that  tracked  the  contractor's  re¬ 
sponses  to  previously  identified  deficien¬ 
cies.  Finally,  they  recommended  new  pro¬ 
cedures  and  training  to  implement  these 

V;|  recommen(ja_ 

"This  process 
[research  tourna¬ 
ments]  should  pro¬ 
mote  innovation  on 
the  part  off  the 
offfferors,  and  pro¬ 
vide  firmer  cost 
estimates  for  equip¬ 
ment,  since  costs 
would  be  based 
upon  completed 
hardware  versus 
conceptual  hardware 


tions.  In  sum¬ 
mary,  the  GAO 
report  stated 
that  to  achieve 
these  new  pro¬ 
cedures,  more 
time  would 
have  to  be  spent 
on  day-to-day 
operations  and 
procedures, 
which  would 


estimates."  possibly  require 

more  staff  to  re¬ 
view  the  processes.  Isbell  (1992)  also  dis¬ 
cussed  some  NASA  recommendations, 
whereby  these  contracts  should  have  a 
negative  or  zero  fee,  if  the  contractor’s 
performance  were  not  up  to  expectations. 

Suggestions.  One  way  to  address  this 
problem  would  be  for  the  contractor  to 
specify  in  his  proposal  what  he  would  con¬ 
sider  to  be  appropriate  rewards  for  spe¬ 
cific  goals  (Fullerton,  1995a).  This  would 
allow  the  source  selection  committee  to 
perform  the  up-front  tradeoffs  and  assess¬ 
ments  of  the  incremental  cost  require¬ 
ments  that  Kaminski  (1995)  has  sug¬ 
gested.  It  would  also  reduce  the  arbitrary 
nature  of  what  constitutes  an  improve¬ 
ment,  and  make  the  award  equal  to  what 
the  contractor  feels  it  should  be  worth. 


This  simple  process  would  eliminate  most 
of  the  problems  associated  with  award  fee 
contracts,  and  also  save  time  and  effort 
on  the  part  of  the  government. 

Research  Tournaments 

Recently,  Fullerton  (1995a  and  1995b), 
Fullerton  and  McAfee  (1996),  and  Taylor 
(1995)  have  expressed  some  novel  and 
interesting  proposals  concerning  compe¬ 
tition.  In  these  “research  tournaments,”  the 
competition  procedure  is  structured  as  an 
auction  and  prototype  competition,  with 
the  winner  awarded  a  “prize”  for  the  best 
product.  The  auction  component  consists 
of  the  participants  paying  a  fee  for  enter¬ 
ing  the  tournament,  which  could  be  used 
to  defray  the  cost  of  the  prize,  or  offset 
the  cost  of  conducting  the  competition. 

The  government  would  commit  to  pay 
the  research  tournament  winner  a  prize 
that  would  be  verifiable  by  the  courts  (i.e., 
a  prize  that  must  be  awarded).  The  selec¬ 
tion  of  the  winner  would  be  based  upon 
specified  priorities  (e.g.,  performance  or 
cost)  established  by  the  government, 
which  would  be  specified  in  the  request 
for  proposal,  so  that  the  competing  firms 
would  know  which  innovations  or  priori¬ 
ties  were  most  important  in  winning  the 
prize.  Finally,  each  firm  would  submit  its 
prototype  at  the  end  of  a  specified  period 
of  time,  for  the  government  to  evaluate 
and  subsequently  award  the  prize  for  the 
best  product.  Thus,  the  competition  would 
differ  from  a  patent  competition,  in  that  it 
would  select  the  most  innovative  design 
across  a  group  of  offerors  that  would  win, 
with  the  quality  of  the  design  stressed  over 
the  date  of  discovery. 

This  process  should  promote  innova¬ 
tion  on  the  part  of  the  offerors,  and  pro- 
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vide  firmer  cost  estimates  for  equipment, 
since  costs  would  be  based  upon  com- 
pleted  hardware  versus  conceptual  hard¬ 
ware  estimates.  Rich  and  Janos  (1994)  also 
point  out  “the  beauty  of  a  prototype  is  that 
it  can  be  evaluated,  and  its  uses  clarified, 
before  costly  investments  for  large  num¬ 
bers  are  made.”  This  is  also  in  keeping 
with  DoD  Directive  5000.1  (1996),  which 
stresses  modeling  and  simulation  of  new 
systems.  An  additional  benefit  of  this  type 
of  procurement  is  that  it  should  require  less 
government  oversight,  since  the  offeror 
has  already  developed  the  item,  and  is  of¬ 
fering  it  at  a  fixed  price  to  the  government. 
Thus,  concern  about  overseeing  develop¬ 
ment  and  production  costs  is  negated.  Fi¬ 
nally,  as  mentioned  above,  the  contractors 
could  specify  along  with  their  proposals 
what  they  consider  to  be  appropriate  re¬ 
wards  or  fees  for  additional  or  alternative 
performance  goals.  This  would  allow  the 
source  selection  authority  to  perform  up¬ 
front  tradeoffs  and  assessments. 

This  type  of  contract  would  seem  most 
suited  for  procurements  that  have  either 
spin-on  or  spin-off  possibilities,  and  where 
there  are  opportunities  for  commercial 
application  of  the  developed  product.  This 
would  prompt  the  developer  to  risk  capi¬ 
tal  investments  in  the  hope  of  significant 
commercial  gains.  The  concept  behind  this 
type  of  procurement  is  not  new.  The  first 
instance  of  its  use  was  seen  in  the  devel¬ 
opment  of  the  steam  locomotive  in  En¬ 
gland  in  1829  (Day,  1971),  where  £500 
was  awarded  for  the  “fastest”  steam  loco¬ 
motive  that  met  the  railroad’s  require¬ 
ments.  In  this  contest,  five  offerors  en¬ 
tered,  but  three  of  the  locomotives  did  not 
meet  the  requirements  stated  by  the  rail¬ 
road,  so  competitive  races  were  run  be¬ 


tween  the  remaining  two  locomotives,  the 
“Rocket”  and  the  “Novelty.”  The  Rocket 
was  the  eventual  winner,  with  the  Nov¬ 
elty  breaking  down  on  one  of  the  com¬ 
petitive  trial  runs.  This  example  demon¬ 
strates  one  of  the  advantages  of  a  proto¬ 
type  competition,  in  that  the  demos  can 
be  tested  in  a  face-off,  which  would  re¬ 
veal  design  problems  that  may  not  be  ob¬ 
vious  in  a  review  of  design  drawings. 
More  recently,  the  selection  of  the  high- 
definition  TV  standards  (The  Economist , 
1993),  and  the  Air  Force’s  Advanced  Tac¬ 
tical  Fighter  (Easterbrook,  1991;  Opall, 
1991)  were  based  upon  prototype  compe¬ 
titions.  Opall  (1991)  points  out  that  while 
the  contractors 

were  not  happy  "One  of  the  difficwl- 
with  investing  ties  of  a  prise  pro- 
so  much  money  cess  is  deteriwi«ilnj| 
up-front  on  a  who!  the  amount  of 
program,  they  «**  prize  should  be." 

do  expect  to  re¬ 
cover  their  investments  with  a  profit  on 
the  system  within  10  years,  and  consid¬ 
ered  that  the  technologies  they  developed 
as  part  of  their  effort  would  give  them  a 
leg  up  on  future  contracts. 

One  of  the  difficulties  of  a  prize  pro¬ 
cess  is  determining  what  the  amount  of 
the  prize  should  be.  One  approach  would 
be  to  set  the  award  to  a  level  commensu¬ 
rate  with  what  the  government  felt  the 
work  effort  to  be  worth;  but,  as  with  the 
award  fee,  would  have  problems  with  its 
arbitrary  nature.  Another  approach  has 
been  suggested  by  Rogerson  (1989), 
which  would  involve  basing  the  prize  on 
a  formula  that  uses  the  price  of  a 
company’s  stock.  In  that  way,  the  prize 
could  vary  from  one  company  to  another, 
but  it  would  still  have  the  same  magni- 
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tude  of  importance  to  the  offeror.  This 
approach  would  allow  for  computing  the 
prize  in  advance,  so  the  source  selection 
authority  could  use  that  information  in  its 
determination. 

Fullerton  (1995a)  has  suggested  that  the 
contractor  specify  in  his  proposal  what  he 
would  consider  to  be  an  appropriate  re¬ 
ward  for  his  efforts,  and  that  amount,  like 
Rogerson’s,  could  be  taken  into  consider¬ 
ation  in  the  source  selection.  Or,  if  the 
contract  award  was  large  enough,  or  had 
commercial  applications,  the  award  could 
constitute  just  the  winning  of  the  contract, 
since  the  follow-on  work  would  generate 
sufficient  commercial  incentives  for  the 
company.  With  these  various  alternative 
approaches  to  determine  the  nature  of  the 
award,  it  would  depend  upon  the  type  of 
procurement  as  to  which  method  would 
be  more  appropriate. 


Summary 


In  keeping  with  Dr.  Kaminski’s  recom¬ 
mendations  concerning  incentivizing 
change  away  from  the  one-size-fits-all 
mode  of  contracting,  these  contract  ve¬ 
hicles — incentive  contracting,  award  fee 
contracting,  and  research  tournaments — 
should  be  viewed  as  approaches  that  can 
be  used  to  bring  benefits  to  the  modern¬ 
ization  of  government  equipment.  The 
specific  type  of  reward  contract  to  use  to 
achieve  these  benefits  would  seem  to  be 
dependent  upon  the  type  of  benefit  de¬ 
sired,  the  amount  of  government  oversight 
available,  and  the  amount  of  risk  placed 
upon  the  contractor. 
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TUTORIAL 


THE  GOVERNMENT  PERFORMANCE 
AND  RESULTS  ACT: 
STRATEGIC  PLANNING 
OF  THE  FUTURE 

Beryl  Hannan 


The  Government  Performance  and  Results  Act  (GPRA)  was  signed  into  law 
on  Aug.  3, 1993.  In  the  view  of  the  Office  of  Management  and  Budget  (OMB), 
it  is  intended  to  shift  the  focus  of  government  officials  from  program  inputs  to 
program  execution.  The  goal  is  to  better  see  what  is  being  achieved  and  how 
well  government  programs  meet  intended  objectives,  rather  than  accept  the 
old  bottoms-up  estimating  methodology.  As  Whittaker  (1995,  p.  60)  contends, 
“...  the  law  is  simple  and  straightforward;  don’t  emphasize  what  funds  have 
been  spent  or  what  level  of  activity  has  been  accomplished,  but  show  the  results 
of  your  efforts.”  This  paper  will  explore  the  tenets  of  GPRA,  particularly  those 
associated  with  strategic  planning.  It  will  also  address  some  of  the  history, 
implementation,  and  potential  consequences  of  the  Act. 


The  Government  Performance  and 
Results  Act’s  objective  is  “to  provide 
for  the  establishment  of  strategic 
planning  and  performance  measurement 
in  the  Federal  Government,  and  for  other 
purposes.”  It  bases  this  objective  on  the 
findings  that: 

L  Waste  and  inefficiency  in  federal 
programs  undermines  the  confidence  of 
the  American  people  in  the  Government 
and  reduces  the  Federal  Government's 
ability  to  address  adequately  vital  needs; 


2.  Federal  managers  are  seriously  dis¬ 
advantaged  in  their  efforts  to  improve  pro¬ 
gram  efficiency  and  effectiveness,  because 
of  insufficient  articulation  of  program 
goals  and  inadequate  information  on  pro¬ 
gram  performance ;  and 

3.  Congressional  policymaking, 
spending  decisions,  and  program  over¬ 
sight  are  seriously  handicapped  by  insuf¬ 
ficient  attention  to  program  performance 
and  results. 
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It  then  goes  on  to  state  the  purposes  of 
the  Act  is  to: 

L  improve  the  confidence  of  the 
American  people  in  the  capability  of  the 
Federal  Government ,  by  systematically 
holding  federal  agencies  accountable  for 
achieving  program  results ; 

2.  initiate  program  performance  re¬ 
form  with  a  series  of  pilot  projects  in  set¬ 
ting  program  goals ,  measuring  program 
performance  against  those  goals,  and  re¬ 
porting  publicly  on  their  progress; 

3.  improve  Federal  program  effective¬ 
ness  and  public  accountability  by  promot¬ 
ing  a  new  focus  on  results,  service  qual¬ 
ity,  and  customer  satisfaction ; 

4.  help  Federal  managers  improve 
service  delivery,  by  requiring  that  they 
plan  for  meeting  program  objectives  and 
by  providing  them  with  information  about 
program  results  and  service  quality ; 

5 .  improve  congressional  decision 
making  by  providing  more  objective  infor¬ 
mation  on  achieving  statutory  objectives, 
and  on  the  relative  effectiveness  and  effi¬ 
ciency  of  federal  programs  and  spending; 
and 


6 .  improve  internal  management  of  the 
Federal  Government. 

With  these  findings  and  purposes  in 
mind,  each  agency  was  required  to  sub¬ 
mit  a  strategic  plan  to  the  Director  of  the 
Office  of  Management  and  Budget  (OMB) 
and  to  Congress  by  Sept.  30,  1997,  with 
the  first  annual  Performance  Plan  for  fis¬ 
cal  year  1999.  This  strategic  plan  must 
include  a  comprehensive  mission  state¬ 
ment;  a  description  of  outcome-related 
general  goals  and  objectives  and  the  op¬ 
erational  processes  and  resources  required 
to  meet  these  goals;  a  description  of  the 
relationship  between  performance  goals 
and  general  goals  and  objectives;  an  iden¬ 
tification  of  key  external  factors  that  could 
effect  achievement;  a  description  of  pro¬ 
gram  evaluations  used  to  establish  or  re¬ 
vise  goals  and  objectives;  and  a  schedule 
for  future  program  evaluations. 

The  initial  plan  must  cover  a  period  of 
not  less  than  five  years,  computed  forward 
from  the  fiscal  year  in  which  it  is  submit¬ 
ted;  and  must  be  updated  at  least  once  ev¬ 
ery  three  years.  The  agency  must  consult 
with  Congress  on  the  plan’s  formulation 
and  must  consider  the  views  of  those  af¬ 
fected  by,  or  interested  in  the  plan  (i.e., 
the  customer  or  stakeholder  in  the  pro¬ 
cess).  In  addition,  the  planning  is  consid- 
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ered  an  inherently  governmental  activity, 
which  means  it  cannot  be  performed  by 
private  enterprise.  Only  the  Central  Intel¬ 
ligence  Agency  (CIA),  the  General  Ac¬ 
counting  Office  (GAO),  the  Panama  Canal 
Commission,  the  United  States  Postal  Ser¬ 
vice,  and  the  Postal  Rate  Commission  are 
exempted  from  the  provisions  of  the  Act. 

As  a  result,  practically  all  the  Execu¬ 
tive  agencies,  including  Department  of 
Defense  (DoD),  have  to  establish  strate¬ 
gic  plans  that  comply  with  the  Act’s  per¬ 
formance  requirements.  Strategic  plans 
will  form  the  basis  of,  and  result  in,  the 
establishment  of  annual  performance 
plans,  based  on  measurable  goals,  that  will 
define  effective  or  successful  programs. 
To  accomplish  these  plans,  each  agency 
has  been  given  the  flexibility  to  aggregate, 
disaggregate,  or  consolidate  program  ac¬ 
tivities,  providing  that  agencies  adhere  to 
current  requirements.  There  are  also  new 
terms  to  be  used  (“outcome  measures,” 
“output  measures,”  “performance  goals,” 
“performance  indicators,”  “program  ac¬ 
tivities”  and  “program  evaluation”)  when 
implementing  GPRA. 

In  the  fiscal  year  2000  budget  submis¬ 
sion,  DoD  (along  with  other  Executive 
agencies)  is  required  to  submit,  through 
OMB,  the  first  program  performance  re¬ 
port  to  Congress  and  the  President.  This 
report  will  document  how  well  the  agency 
is  performing  and  whether  it  has  accom¬ 
plished  what  it  proposed  to  do.  It  will  dis¬ 
cuss  the  performance  indicators  that  were 
used,  the  program  results  (success  or  fail¬ 
ure)  that  were  measured,  any  problems  ex¬ 
perienced  with  performance  goals,  and 
factors  affecting  performance  that  were 
beyond  the  control  of  the  agency  involved. 
Theoretically  then,  in  the  future,  Congress 
and  the  President  will  be  able  to  decide 


ptaiiSr  based  on 
measurable  goals, 
that  will  define 
effective  or  success¬ 
ful  programs."  -  < 


whether  to  continue  DoD  programs,  re¬ 
vise  programs,  or  totally  cancel  programs 
they  perceive  as  an  ineffective  use  of  gov¬ 
ernment  funding  based  on  the  perfor¬ 
mance  information  submitted  in  the  per¬ 
formance  report.  This  will,  in  turn,  allow 
Congress  and 
the  President  to 

construct  a  na- ;  "Strategic  plans  will 
tional  budget'  form  the  basis  of# 
that  is  meaning-  t>*»d  result  in,  the 
ful— based  on  •rtablUhiwent  of 

actual  govern¬ 
ment  perfor¬ 
mance — and  to 
construct  a  bud¬ 
get  that  will  re¬ 
ceive  favorable 
public  accep¬ 
tance. 

There  were  also  a  significant  number 
of  pilot  projects  authorized  under  the  Act 
(Barr,  1994,Panetta,  1994).  These  projects 
provided  participating  agencies  with  valu¬ 
able  experience.  Within  DoD,  the  Defense 
Logistics  Agency  (DLA),  Air  Combat 
Command,  the  Army  Research  Labora¬ 
tory,  the  Defense  Commissary  Agency,  the 
U.S.  Army  Corps  of  Engineers  (Civil 
Works),  the  Army  Audit  Agency,  and 
CINCLANTFLT  (Carrier  Battle  Group) 
all  participated  in  pilot  projects.  Results 
from  these  pilots  have  shown  that  GPRA 
is  flexible  enough  to  accommodate  the 
needs  of  organizations  having  signifi¬ 
cantly  diverse  missions. 

One  part  of  the  pilot  program  process 
has  not  been  successful — that  having  to 
do  with  managerial  flexibility  and  ac¬ 
countability.  GPRA  allowed  agencies  to 
propose  and  OMB  to  approve  waivers  of 
certain  nonstatutory  administrative  re¬ 
quirements  and  controls  (e.g.,  staffing,  re- 
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numeration,  and  funding  transfers)  to  al¬ 
low  for  more  managerial  flexibility  and 
accountability.  To  date,  no  waivers  have 
been  approved  under  this  authority.  This 
is  due  in  part  to  elimination  of  the  bulk  of 
the  “Federal  Personnel  Manual,”  enact¬ 
ment  of  the  Federal  Workforce  Restruc¬ 
turing  Act,  and 
the  ability  to 
approve  waiv¬ 
ers  under  exist¬ 
ing  administra¬ 
tive  authorities 
independent  of 
GPRA.  There¬ 
fore,  some  in¬ 
ternal  changes  to  administrative  require¬ 
ments  have  been  possible  without  imple¬ 
mentation  of  the  waiver  process. 

What  then  generated  the  need  for 
GPRA?  Why  did  Congress  feel  compelled 
to  write  such  a  law  and  impose  this  type 
of  strategic  management  system  on  the 
Executive  agencies? 


"In  the  context  of 
|  administrative 
reform,  government 
reform  occurred  on 
two  levels:  political 
and  managerial." 


History 


It  is  somewhat  difficult  to  determine  the 
underlying  impetus  of  GPRA  statutory 
requirements.  It  can  be  looked  at  in  the 
context  of  administrative  reform 
(Rosenbloom,  1995),  budget  reform, 
(Rubin,  1993),  the  history  of  planning, 
(Mintzberg,  1994),  or  more  simply,  the 
emphasis  on  efficiency  and  effectiveness 
that  has  formed  the  underpinnings  of  gov¬ 
ernmental  reform  since  the  signing  of  the 
Constitution.  In  fact,  the  desire  for  effi¬ 
ciency  and  effectiveness  is  the  major  po¬ 
litical  force  that  drives  our  national  poli¬ 
cies  and  priorities.  This  is  true  whether  we 
ascribe  to  the  “effective”  government  of 


the  National  Performance  Review  (NPR) 
or  the  “efficiency”  of  a  balanced  budget 
as  stated  within  the  Contract  with 
America.  Therefore,  since  its  antecedents 
are  vague,  we  can  only  make  some  gener¬ 
alizations  and  then  consider  recent  history 
in  the  development  of  the  Act  itself. 

In  the  context  of  administrative  reform, 
government  reform  occurred  on  two  lev¬ 
els:  political  and  managerial.  These  are 
defined  as  fundamental  redefinitions  of 
public  administration  which  occurred  to 
fit  a  particular  political  need  or  vision  (po¬ 
litical);  and  adjustments  within  the  exist¬ 
ing  administrative  framework  (manage¬ 
rial)  (Rosenbloom,  1995).  On  the  politi¬ 
cal  level,  this  has  been  translated  into  four 
fundamental  approaches  to  public  admin¬ 
istration,  with  the  National  Performance 
Review  a  possible  fifth. 

The  first  approach,  perceived  as  the 
“administration  by  gentlemen,”  was  em¬ 
ployed  between  1789  and  1828.  In  this  era 
“voting  privileges  were  restricted  and  po¬ 
sitions  in  federal  service  were  viewed 
loosely  as  property  and  often  held  for  life” 
(Rosenbloom,  p.  3).  The  second  approach, 
the  “spoils  system,”  was  in  play  from  1 829 
to  thel880s.  This  system  was  aimed  at 
delivering  “federal  service  into  the  arms 
of  the  political  party  in  power”  through 
favoritism  and  patronage  (p.  3).  The  third 
theory  of  public  administration,  which 
Rosenbloom  calls  “the  merit  system  and 
political  neutrality,”  was  put  in  practice 
from  1883  to  the  1930s.  This  system 
sought  to  destroy  the  political  machines 
and  defined  public  administrators  as  “le¬ 
gally  insulated,  politically  neutral,  trained 
experts”  who  should  be  promoted  based 
on  merit  (i.e.,  performance)  (p.  4).  The 
fourth,  “the  New  Deal,”  from  1933-1939, 
placed  emphasis  on  selecting  appointees 
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based  on  “policy  agreement  and  ability 
rather  than  partisanship  alone”  and  estab¬ 
lished  the  Bureau  of  the  Budget  (now 
known  as  the  Office  of  Management  and 
Budget)  within  the  Executive  Branch  (p.  4). 
Finally,  the  NPR,  from  1993  to  the  present, 
seeks  to  establish  an  entrepreneurial,  com¬ 
petitive,  customer-driven,  results-oriented 
public  administration,  with  an  administra¬ 
tive  capacity  to  intervene  in  the  society 
and  economy,  “strengthen  executive  con¬ 
trol  and  drastically  reduce  congressional 
involvement”  (p.  4). 

On  a  managerial  level,  reforms  have 
been  aimed  at  improving  performance  and 
at  fashioning  adjustments  within  the  ad¬ 
ministrative  framework.  These  reforms 
can  be  identified  as  process  reforms  (e.g., 
the  planning,  programming,  budgeting 
system  or  total  quality  management),  and 
structural  reforms  (e.g.,  creation  of  the 
Office  of  Management  and  Budget  in 
1970).  Each  activity  in  turn,  has  left,  or  is 
leaving,  a  legacy  of  change. 

Therefore,  in  terms  of  administrative 
reform,  the  GPRA  is  a  hybrid  of  the  pro¬ 
cess  and  structural  reform  movements.  As 
Rosenbloom  contends,  it  is  politically  con¬ 
nected  to  NPR,  but  is  institutionally  at 
odds  with  it,  since  in  his  opinion  it  grants 
Congress  more  power  in  dealing  with  ad¬ 
ministrative  agencies  by  effectively  mak¬ 
ing  the  agencies  an  extension  of  the  legis¬ 
lature  in  the  refinement  of  legislative 
goals.  Further,  it  uses  strategic  planning 
to  develop  or  reduce  agency  missions. 

Focusing  on  budget  reform,  we  see  a 
slightly  different  picture.  As  Rubin  points 
out,  the  need  for  budget  reform  grew  out 
of  the  need  for  clear  financial  reporting  to 
provide  greater  public  accountability  of 
government  funding.  The  railroads  during 
the  late  1 800s  took  a  heavy  toll  on  public 


finances  because  they  not  only  borrowed 
heavily  from  private  sources,  but  were 
often  government  subsidized.  While  im¬ 
portant  to  commerce,  the  railroads  had 
such  poor  accounting  systems  that  audi¬ 
tors  found  it  virtually  impossible  to  tell 
whether  rail- 

road  companies  ^  Rubin  po|nt,  #1|f# 
were  actually  |||e  „eed  ,or  budget 
experiencing  a ;  reform  grew  out  of 
profit  or  loss  the  need  for  dear 
(Rubin,  1993).  financial  reporting 
Consequently,  to  provide  greater 
in  1906,  the  In-  public  accountability 
terstate  Com- '  government 
merceCommis-  funding* 
sion  promul¬ 
gated  the  Hepburn  Act,  which  established 
uniform  accounting  principles  for  the  rail¬ 
roads  and  other  private  sector  organiza¬ 
tions.  Once  this  accounting  system  was 
imposed  on  private  organizations,  the  fed¬ 
eral  government  was  pressured  to  adopt 
similar  measures.  This  resulted  in  the  Bud¬ 
get  and  Accounting  Act  of  1921. 

Based  on  the  recommendations  of  the 
Taft  Commission  on  Economy  and  Effi¬ 
ciency,  the  Budget  and  Accounting  Act  re¬ 
quired  the  President  to  submit  an  annual 
budget  to  the  Congress,  along  with  any 
other  financial  statements  and  data  nec¬ 
essary  to  determine  the  financial  condi¬ 
tion  of  the  government  (Mosher,  1976).  It 
also  established  the  Bureau  of  the  Bud¬ 
get,  which  was  transferred  to  the  Execu¬ 
tive  Branch  in  1939.  This  Bureau  was  re¬ 
named  the  Office  of  Management  and 
Budget  in  1970,  and  now  manages  the 
yearly  budget  requirements.  As  a  result, 
OMB  is  responsible  for  approving  the  pi¬ 
lot  projects  under  GPRA  (Panetta,  1994); 
and  has  ultimate  responsibility  for  the 
implementation  of  the  GPRA  reform  pro- 
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the  planning 
process  itself  found 
its  beginnings  in  the 
tenets  of  military 
strategy  and  can  be 
traced  as  far  back  in 
time  as  man  has 
(  recorded  memory." 


cess.  Therefore,  under  the  umbrella  of 
budget  reform  there  has  been  an  empha¬ 
sis  on  financial  responsibility  and  public 
accountability  rather  than  political  vision 
or  adjustments  in  administrative  manage¬ 
ment. 

Lastly,  the  planning  process  itself  found 
its  beginnings  in  the  tenets  of  military 
strategy  and  can  be  traced  as  far  back  in 
time  as  man  has  recorded.  Whether  one 
views  the  history  of  the  Children  of  Is¬ 
rael,  the  Greeks, 
the  Romans,  the 
Allied  thrust  in 
World  Warn,  or 
more  recently 
Desert  Storm, 
one  sees  a  series 
of  battle  plans 
and  strategies 
followed  with 
composite  pre¬ 
cision.  It  is  not  surprising,  therefore,  to  see 
this  same  tenet  carried  into  the  manage¬ 
ment  of  corporations  as  the  span  of  con¬ 
trol  became  diffuse  and  complex,  or  to 
government  management  with  its  bureau¬ 
cratic  stratification.  Only  the  manner  and 
the  context  in  which  it  has  been  applied 
has  changed. 

According  to  Bryson  (1988,  p.  22), 
“Strategic  planning  . . .  began  as  the  art  of 
the  general.”  The  word  “strategic,”  as  in 
strategic  planning,  is  a  derivative  of  the 
word  “strategy”  which  in  turn  comes  from 
the  Greek  word  strategos  (stratos  [army] 
and  egos  [to  lead]).  A  strategy,  on  the  other 
hand,  can  be  defined  in  two  ways:  it  is  a 
plan — “a  direction,  a  guide  or  course  of 
action  into  the  future” — or  it  is  a  pattern 
— “consistency  in  behavior  over  time” 
(Mintzberg,  1994,  p.  23).  These  two  defi¬ 
nitions  are  usually  described  as  “intended” 


strategy  and  “realized”  strategy.  In  other 
words,  what  is  intended  is  not  always  re¬ 
alized.  Therefore,  what  happens  in  actual 
fact  is  “emergent”  strategy.  An  effective 
strategy  emerges  from  the  ability  to  pre¬ 
dict  as  well  as  react  to  unexpected  events. 
Strategic  planning,  as  it  is  mandated  un¬ 
der  GPRA,  requires  a  recognition  of  the 
complex  and  dynamic  environment  of 
government.  Consequently,  it  will  drive 
implementers  to  outline  broad  targets,  pro¬ 
vide  considerable  flexibility  to  adapt  to  un¬ 
expected  events. 

The  issues  of  efficiency  and  effective¬ 
ness  have  also  been  applied  with  differ¬ 
ent  meanings  in  different  contexts.  While 
viewed  one  way  at  the  writing  of  the  Con¬ 
stitution,  they  are  considered  differently 
in  a  world  of  budget  deficits,  global  com¬ 
petition,  and  mandatory  taxation.  Conse¬ 
quently,  for  purposes  of  GPRA,  these  con¬ 
cepts  should  be  viewed  within  the  precepts 
of  the  NPR.  For  it  is  the  NPR  that  has  cap¬ 
tured  GPRA  as  an  outgrowth  of  its  goals 
and  ideals  as  a  way  of  fashioning  an  effi¬ 
cient,  effective  government — one  that 
“works  better  and  costs  less.”  How  then 
is  strategic  planning  within  GPRA  being 
implemented  and  what  is  its  probability 
for  success? 


Implementation  of  GPRA 


The  GPRA  was  first  introduced  in  the 
Senate  by  Sen.  William  Roth  in  October 
1990,  as  the  Federal  Standards  and  Goals 
Act;  reintroduced  after  failure  in  1991; 
retitled  as  GPRA  and  amended  by  Sen. 
John  Glenn  in  1992;  reintroduced  in  Janu¬ 
ary  1993  as  the  first  piece  of  reinventing 
legislation  addressed  by  the  Administra- 
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tion  and  signed  into  law  August  that  same 
year.  Therefore,  after  a  difficult  political 
beginning,  it  is  now  being  implemented. 
Ten  pilot  projects  were  approved  in  the 
first  year  and  five  times  that  number  were 
added  in  the  second.  Yet  it  has  not  sur¬ 
vived  without  problems.  As  Stephen  Barr 
of  the  Washington  Post  noted  in  February 
1994;  “If  all  goes  as  planned  over  the  next 
three  years,  OMB  [will]  learn  how  to  link 
strategic  planning  to  the  budget,  . . .  [but] 
for  all  the  high-level  attention,  perfor¬ 
mance  management  remains  one  of  the 
least  understood  administration  initia¬ 
tives.” 

To  overcome  some  of  these  misunder¬ 
standings,  John  Koskinen  (1994)  issued  a 
memorandum  on  Nov.  18,  1994,  entitled 
“Requirement  for  Strategic  Planning  Un¬ 
der  the  Government  Performance  and 
Results  Act.”  In  this  memorandum 
Koskinen  addressed  the  importance  of 
strategic  planning  as  both  the  foundation 
and  framework  for  implementation  of  all 
other  parts  of  the  Act  and  expressed 
OMB’s  intention  to  issue  guidance  in  early 
1995  on  the  development  and  submission 
of  strategic  plans.  The  first  step  was  to 
establish  a  strategic  planning  task  group 
to  help  prepare  the  guidance.  Koskinen 
was  particularly  concerned  with  inter¬ 
agency,  programmatic,  and  policy  goals 
and  was  looking  to  this  group  and  the 
President’s  Management  Council  to  define 
the  means  and  the  responsibility  for  as¬ 
suring  “that  goals  are  consistently  and 
harmoniously  reflected  in  individual 
agency  plans.”  As  an  adjunct  to  the  stra¬ 
tegic  planning  task  group,  a  task  group  was 
formed  in  November  1 994  to  consult  with 
Congress  in  developing  strategic  plans  and 
to  participate  in  a  Congressional  coordi¬ 
nation. 


Direction 

p  * 

submitted  with 
the  memoran- 
dum  required 
that  strategic 
planning  be  de¬ 
veloped  with 
Congressional 
consultation.  §: 
Guidance  on  this 
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dressed  the  impor¬ 
tance  of  strategic 
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the  Act  and 


eluded  in  Circu-  pressed  OMB's 

intention  to  issue 
guidance  in  early 
199§  on  the  devel¬ 
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larA-11,  Section 
10.8,  in  Septem¬ 
ber  1995  and 
then  updated  in 
Part  2,  entitled  | 

“Preparation  | 
and  Submission  -  •  r':”  ' 

of  Strategic  Plans  and  Annual  Perfor¬ 
mance  Plans,”  in  May  1997.  Based  on  a 
collaborative  effort  of  OMB,  the  Cabinet 
departments,  and  20  independent  agen¬ 
cies,  the  circular  requires  that  “an  agency 
strategic  plan  provides  for  aligning  agency 
organization  and  budget  structure  with 
missions  and  objectives.”  It  goes  on  to 
state  that  “These  plans  are  a  tool  for  agen¬ 
cies  in  setting  priorities  and  allocating  re¬ 
sources  consistent  with  these  priorities. . . .” 


Part  2  of  the  same  circular  sets  out  more 
specific  requirements  for  the  submittal  of 
each  plan. 

While  an  initial  strategic  plan  must  have 
been  submitted  by  Sept.  30,  1997,  and 
must  cover  a  minimum  of  five  years  or 
longer,  it  is  specifically  noted  that  the  plan 
is  in  fact  only  good  for  three  years — after 
which  it  must  be  updated.  This  is  to  en¬ 
sure  that  agencies  are  monitoring  and  ad¬ 
justing  their  plans  on  a  continuous  basis. 
Agencies  are  strongly  encouraged  to  sub¬ 
mit  a  single  agency  plan,  but  if  not,  a  stra- 
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tegic  overview  must  be  submitted  that 
links  the  individual  plans  to  the  agency’s 
missions  and  goals.  The  initial  Annual  Per¬ 
formance  Plan  must  have  been  submitted 
to  OMB  in  September  of  this  year  in  sup¬ 
port  of  the  fiscal  year  1999  budget. 

Furthermore,  agencies  are  required  to 
document  disagreement  pertaining  to 
agency  goals.  The  transmittal  letter  should 
summarize  dissenting  views  received  from 
entities  outside  the  Executive  branch  of 
government,  the  degree  of  disagreement, 
and  the  source(s).  This  will  ensure  that 
agencies  are  providing  an  opportunity  for 
stakeholders  to  have  a  voice  in  the  deci¬ 


sion-making  process.  In  addition,  the  com¬ 
pleted  strategic 

"The  complexity  •#  Pla"  mus,t  * 

government  pro-  made  available 

grams,  divergent  t0  public  at 

perspectives,  and  the  same  time  it 
unclear  missions  and  is  transmitted  to 
perspectives  make  It  Congress — so 
extremely  difficult  that  those  same 
for  decision  makers  stakeholders 
to  develop,  under.  have  an  oppor. 
stand,  and  Interpret  tunj  t0  under. 

information  reperted  stand  what  . 
results" 

incorporated  in 
the  plan. 

It  is  up  to  OMB  to  decide  if  the  indi¬ 
vidual  plan  lacks  required  elements  or  is 
inconsistent  with  national  policy  and  re¬ 
quires  further  work  by  the  submitting 
agency.  As  part  of  a  1996  summer  review, 
OMB  provided  internal  guidance  to  OMB 
resource  management  offices  to  assist 
them  in  reviewing  and  consulting  with  the 
agencies  under  their  purview.  This  guid¬ 
ance  consisted  of  a  set  of  questions  to  con¬ 
sider  when  guiding  the  implementation  of 
the  strategic  planning  process.  Interagency 
clearance  of  a  completed  strategic  plan  is 


now  required  at  least  45  days  before  sub¬ 
mission  to  Congress.  Consequently,  con¬ 
siderable  guidance  exists  in  the  strategic 
planning  area. 

Of  particular  difficulty  in  the  GPRA 
process  has  been  the  institution  of  mea¬ 
surement.  The  complexity  of  government 
programs,  divergent  perspectives,  and 
unclear  missions  and  perspectives  make 
it  extremely  difficult  for  decision  makers 
to  develop,  understand,  and  interpret  in¬ 
formation  and  reported  results  (Kravchuck 
and  Schack,  1996).  To  assist  in  this  pro¬ 
cess,  OMB  issued  a  “Primer  on  Perfor¬ 
mance  Measurement”  in  February  1995. 
This  primer  is  designed  to  assist  the  stra¬ 
tegic  planner  in  identifying  and  defining 
methods  of  measurement  for  their 
agency’s  activities.  As  such,  it  defines  sev¬ 
eral  performance  measurement  terms,  out¬ 
lines  areas  or  functions  where  perfor¬ 
mance  measurement  may  be  difficult,  and 
provides  examples  of  different  types  of 
performance  measures  that  can  be  used  to 
ascertain  performance  outcomes.  In  addi¬ 
tion,  the  Chief  Financial  Officers  Council 
Report,  in  May  of  the  same  year,  provided 
addresses  and  points  of  contact  for  assis¬ 
tance  in  implementing  the  process.  The 
U.S.  Army  Corps  of  Engineers  issued  a 
“Performance  Management  Guidebook” 
in  August  1995,  which  provides  a  perfor¬ 
mance  measurement  framework  and  a  six- 
step  development  process  for  defining 
performance  measurement  in  an  opera¬ 
tions  and  maintenance  arena;  and  DoD 
issued  an  executive  summary  entitled 
“Key  Criteria  for  Effective  Measurement,” 
in  April  1996,  defining  the  purpose,  types, 
and  requirements  for  performance  mea¬ 
surement. 

So  what  has  been  the  progress  to  date? 
An  initial  report  (in  1994)  of  existing  pi- 
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lot  programs  by  the  National  Academy  of 
Public  Administration  highlighted  several 
problems  associated  with  the  process.  Pri¬ 
marily,  performance  plans  did  not  tie  per¬ 
formance  to  strategic  planning.  Neither 
did  they  contain  clear  statements  of  mis¬ 
sions  and  goals.  Specific  recommenda¬ 
tions  were  that  Congress,  program  man¬ 
agers,  and  policy  makers  become  real  part¬ 
ners  in  GPRA’s  implementation  to  resolve 
issues  associated  with  unclear  agency  mis¬ 
sions.  This  included  the  cooperation  of  the 
committees  that  introduced  GPRA  to  help 
to  sell  the  effort  to  the  two  appropriation 
committees.  In  addition,  the  Academy  sug¬ 
gested  that  agencies  work  hard  to  assure 
that  performance  plans  at  all  levels  relate 
to  broader  strategic  thinking  and  mission 
accomplishments;  that  vision  statements 
be  less  general  and  more  useful  in  estab¬ 
lishing  specific  objectives  for  manage¬ 
ment  improvement;  and  that  plans  contain 
mission-oriented  strategic  thinking  repre¬ 
sented  by  the  outcome  indicators. 

Of  major  concern  was  the  lack  of  link¬ 
age  between  management  at  the  political 
or  policy  level  and  the  plans  themselves. 
Part  of  this  problem  was  viewed  as  stem¬ 
ming  from  the  development  of  the  plans 
at  a  very  low  level  within  the  organiza¬ 
tion  and  consequently  focused  on  a  very 
limited  set  of  work  activities  not  specifi¬ 
cally  related  to  broader  strategic  thinking. 
It  is  clear  from  this  report  that  agencies 
had  not  recognized  the  first  principle  of 
strategic  planning,  which  is  “to  produce 
fundamental  decisions  and  actions  that 
shape  and  guide  what  an  organization  is, 
what  it  does,  and  why  it  does  it”  (Bryson, 
1988).  This  requires  the  commitment  and 
involvement  of  top  key  decision  makers 
to  bargain,  negotiate,  and  coordinate  the 
activities  of  affected  parties  (Bryson, 


1988;  Pfeiffer,  1991;  Mintzburg,  1994). 
The  Chief  Financial  Officer’s  Council 


GPRA  Subcommittee’s  report  in  January 
1996  still  reported  the  same  basic  prob¬ 
lem.  While  performance  planning  had  ad¬ 
vanced  substantially  in  some  agencies, 
strategic  plans 
were  not  driv¬ 
ing  the  planning  m<,Ior  concern 

process.  While  w«w  H*®  lack  of 

agencies  were  ,,"ka*0  be#we#" 
agencies  were  manag9menf  at  the 

aiming  to  de-  ^mhnt  „  p.lley 
velopa  single  |«ye|  «„d  the  plans 

set  of  best  mea-  themselves." 
sures,”  integra- . 
tion  of  various 

initiatives  was  very  difficult  and  organi¬ 
zational  disconnects  were  impeding  the 
process.  Part  of  the  problem,  in  their  view, 
stemmed  from  the  lack  of  incentives  to  do 
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good  program  evaluations  and  the  strong 
incentives  to  expand  programs  and  mis¬ 
sions.  As  a  result,  they  recommended  an 
in-depth  review  of  programs  and  agencies 
that  were  providing  credible  performance 
planning.  Based  on  this  recommendation, 
OMB  generated  a  call  for  lessons  learned 
in  recognition  that  agencies  could  benefit 
from  careful  analysis  of  the  process  and 
strategies  that  have  evolved  from  pilot  ex¬ 
periences.  These  lessons  learned,  com¬ 
bined  with  various  GAO  reports,  are  con¬ 
sidered  useful  activities  to  understand  and 


implement  change. 

The  GAO  has,  in  addition,  completed 
a  significant  number  of  reports  concern¬ 
ing  agency  strategic  planning  and  other 
aspects  of  the  statute,  since  the  enactment 
of  GPRA.  These  include  reviews  of  ac¬ 
tivities  associated  with  performance  bud¬ 
geting  (GAO/AFMD  93-41),  performance 
measuring  (GAO  95-1, 95-187),  manage¬ 
ment  issues  (GAO  95-22,  95-158), 
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changes  associated  with  reorganization 
(GAO  95-166,  96-50),  implementation 
status  (GAO  95-130R,  95-167FS,  95- 
193),  performance  reporting  (GAO  96- 
66R),  and  the  role  of  the  Congress  (GAO 
;:;T:  •  96-79). 

These  re- 


"Along  with  these 
key  steps,  the  report 
identities  eight 
management  prac¬ 
tices  that  are  impor¬ 
tant  to  the  success  of 
any  effort/1' 


views  culmi¬ 
nated  in  the 
publication  of 
an  executive 
guide  entitled 
“Effectively 
Implementing 


the  Government 


Performance  and  Results  Act,”  issued  in 
June  1996.  This  guide  identifies  three  key 
steps  that  are  necessary  for  organizations 
to  become  more  results-oriented.  They  are: 


•  Define  mission  and  desired  outcomes 
(strategic  plans  containing  mission 
statements  and  outcome-related  stra¬ 
tegic  goals). 

•  Measure  performance  (annual  perfor¬ 
mance  plans  with  annual  performance 
goals). 


•  Align  activities,  core  processes,  and 
resources  with  the  organizations  mis¬ 
sion. 

•  Produce  a  set  of  performance  mea¬ 
sures  at  each  organizational  level  that 
demonstrates  results,  is  limited  to  the 
vital  few,  responds  to  multiple  priori¬ 
ties,  and  links  to  responsible  pro¬ 
grams. 

•  Collect  sufficiently  complete,  accu¬ 
rate,  and  consistent  data. 

•  Identify  performance  gaps. 

•  Report  performance  information. 

•  Most  importantly,  use  performance 
information  to  support  the  mission  of 
the  organization. 

The  GAO  recognizes  that  these  steps 
and  practices  by  themselves  cannot  ensure 
the  success  of  the  organization.  Leader¬ 
ship  practices  must  reinforce  GPRA 
implementation  and  a  results-oriented 
management.  These  practices  include: 


•  Use  performance  information  (annual 
performance  reports). 

Along  with  these  key  steps,  the  report 
identifies  eight  management  practices  that 
are  important  to  the  success  of  any  effort. 
They  are: 

•  Involve  stakeholders  in  the  process. 

•  Perform  an  assessment  of  the  environ¬ 
ment  (both  external  and  internal). 


•  devolving  decision  making  authority 
within  a  framework  of  mission-ori¬ 
ented  processes  in  exchange  for  ac¬ 
countability  for  results; 

•  creating  incentives  to  encourage  a  fo¬ 
cus  on  outcomes; 

•  building  expertise  in  the  necessary 
skills  needed  to  perform  strategic 
planning,  performance  measurement, 
and  the  use  of  performance  informa¬ 
tion  in  decision  making;  and 
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•  integrating  management  reforms — 
existing  planning,  budgeting,  program 
evaluation,  and  fiscal  accountability 
processes  with  GPRA  requirements  to 
ensure  consistency  while  reducing  du¬ 
plication  of  effort. 

Once  in  place,  the  GAO  suggests  that 
these  key  steps  and  management  practices 
form  the  framework  for  a  GPRA  results- 
oriented  management  culture.  It  is  inter¬ 
esting  to  note  that  although  the  GAO  rec¬ 
ommends  the  inclusion  of  stakeholders, 
there  is  no  recommendation  for  collabo¬ 
rative  leadership  or  teamwork  as  a  desired 
practice  for  GPRA  implementation. 

Other  reports  issued  since  the  Execu¬ 
tive  Guide  have  focused  more  on  areas  of 
significant  concern — for  example,  mana¬ 
gerial  accountability  and  flexibility 
progress  (GAO/GGD-97-36),  Congres¬ 
sional  and  Executive  branch  decision  mak¬ 
ing  (GAO/T-GGD-97-43),  performance 
budgeting  insights  (GAO/AIMD-97-46), 
and  key  questions  to  facilitate  Congres¬ 
sional  review  (GAO/GGD-IO.1.16). 
Therefore,  while  GPRA’s  implementation 
is  progressing,  significant  learning  is  still 
considered  necessary.  What  then  are  some 
potential  consequences  of  the  Act  for 
DoD?  The  Planning,  Programming,  Bud¬ 
geting  System  (PPBS)  was  instituted 
within  the  Department  of  Defense  by 
McNamara  in  the  1960s.  This  system  re¬ 
quires  the  formulation  of  government  ob¬ 
jectives,  like  GPRA.  It  relates  outputs  to 
program  inputs  (unfavorable  impacts).  It 
puts  values  on  inputs  and  outputs;  aggre¬ 
gates  the  outputs  into  total  benefits;  ag¬ 
gregates  the  inputs  into  total  costs;  identi¬ 
fies  the  differences;  considers  existing  as 
well  as  alternative  strategies  of  action,  and 
develops  a  budget  based  on  the  outcomes 


of  these  choices  (Mintzberg,  1994).  The 
differences  between  this  system  and 
GPRA  seem  to 
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Congress,  and  a 
stronger  em¬ 
phasis  on  “per- 1 
formance  out¬ 
comes”  as  op¬ 
posed  to  “out¬ 
puts.”  Outputs  § 
are  seen  as  a  I 
measure  of  the  use  of  resources,  while  per¬ 
formance  outcomes  define  the  success  of 
the  programs.  Therefore,  DoD  established 
the  GPRA  working  group  to  study  ways 
to  refine  PPBS  to  meet  GPRA  legal  re¬ 
quirements  and  to  strengthen  internal  man¬ 
agement  processes. 

The  1993  Bottom-Up  Review,  as  up¬ 
dated  by  the  National  Security  Strategy 
(President)  and  the  National  Military 
Strategy  (JCS),  served  as  the  DoD  strate¬ 
gic  plan  until  completion  of  the  Quadren¬ 
nial  Defense  Review  on  May  19,  1997. 
This  document  superseded  the  Bottom-Up 
Review.  The  Quadrennial  Review  now 
serves  as  the  DoD  strategic  planning  docu¬ 
ment  under  GPRA.  The  DoD  vision  and 
mission  statement  were  published  in  the 
1997  Defense  Planning  Guidance  and  ap¬ 
pear  in  the  GPRA  Annex  of  that  document 
(see  Figure  1)  (Maroni,  1996).  A  set  of 
general  goals  and  objectives  derived  from 
the  Quadrennial  Review  and  also  pub¬ 
lished  in  the  Defense  Planning  Guidance 
are  currently  being  refined  within  DoD  for 
the  fiscal  year  1999  submission  to  Con¬ 
gress.  In  addition,  the  Office  of  Analysis 
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DoD  MISSION  STATEMENT 

The  mission  of  the  Department  of  Defense  is  to  support  and  defend  the  Constitution  of  the 
United  States,  to  provide  for  the  common  defense  of  the  United  States,  its  citizens  and  its 
allies,  and  to  protect  and  advance  U.S.  interests  around  the  world. 

DoD  VISION  STATEMENT 

The  Department  of  Defense: 

•  fields  the  best  trained,  best  equipped,  best  prepared  joint  fighting  force  in  the 
world; 

•  supports  alliance  and  security  relationships  that  protect  and  advance  U.S.  secu¬ 
rity  interests; 

•  advances  national  interests  by  working  effectively  with  other  agencies.  Congress, 
and  the  private  sector;  and 

•  serves  as  a  model  of  effective,  efficient,  and  innovative  management  and  leader¬ 
ship. 


Figure  1.  DoD  Mission  and  Vision  Statements 


and  Evaluation,  OSD(PA&E)  issued  guid¬ 
ance  to  DoD  Components  as  follows: 

The  Chairman,  Program  Review 
Group,  will  establish  a  team  led 
by  OSD(PA&E),  to  assess  the 
performance  of  the  DoD  Compo¬ 
nents,  with  respect  to  the  DoD 
Corporate  Goals  that  are  to  ap¬ 
pear  in  the  Defense  Guidance. 

The  Component  POM  submis¬ 
sions  will  be  used  as  the  basis  for 
this  assessment.  The  outcome  of 
the  assessment  will  be  reported  at 
the  end  of  the  program  review.  In 
addition,  the  team  may  also  re¬ 
view  performance  measures  for 
use  in  GPRA  activities  subse¬ 
quent  to  this  program  review. 


DoD  anticipates  that  the  fiscal  year 
1999-2004  PPBS  cycle  will  contain  all  the 
elements  of  GPRA.  The  first  Annual  Per¬ 
formance  Plan,  which  will  include  perfor¬ 
mance  measurement  criteria,  will  be  sub¬ 
mitted  as  part  of  the  fiscal  year  1999 
President’s  Budget.  Consequently,  DoD  is 
well  on  its  way  to  integrating  GPRA  into 
the  PPBS  budgeting  process. 

Nevertheless,  the  GPRA  is  still  prob¬ 
lematic.  Organizations  most  advanced  in 
GPRA  say  “it  is  turning  us  upside  down” 
(Laurent,  1996).  Since  GPRA  requires  a 
cultural  change  as  it  attempts  to  blend  ac¬ 
countability  with  entrepreneurship.  There 
has  yet  to  be  a  recognition  in  some  agen¬ 
cies  that  there  is  no  risk  without  failure 
(Groszyk,  1995).  Similarly,  measuring 
performance  can  become  a  meaningless. 
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sterile,  statistical  exercise,  if  managers  are 
not  trained  and  empowered  to  promote 
change  and  incorporate  performance- 
based  management  into  daily  practice 
(Laurent,  1996),  or  if  they  do  not  under¬ 
stand  or  take  into  account  the  limitations 
of  performance  measurement  systems 
(Kravchuk  and  Schak,  1996).  Measures 
should  not  become  a  substitute  for  effec¬ 
tive  ongoing  program  management,  but 
meaningful  incentives  for  managers  to 
change  how  they  manage  and  become 
more  accountable  (Groszyk,  1995).  This 
will  require  the  inclusion  of  customers  and 
stakeholders  in  the  validation  process 
(Mihm,  1995-1996).  Meanwhile,  manag¬ 
ers  who  can  master  this  process  and  show 
the  positive  outcomes  of  their  program’s 
efforts  will  have  a  clear  advantage  obtain¬ 
ing  or  retaining  program  funding  (Mihm, 
1995-1996). 

Early  assessments  indicate  that  agen¬ 
cies  are  still  having  difficulty  describing 
the  relationship  between  long-term  goals 
and  annual  performance  goals  and  are  just 
beginning  to  look  at  enhancing  inter¬ 
agency  coordination  for  programs  that  are 
“cross-cutting”  in  nature  (Raines,  1997). 
OMB  has  also  noted  that  a  review  of  per¬ 
formance  goals  is  on-going  and  that  con¬ 
sensus  on  these  goals  still  needs  to  be 
reached  (Koskinen,  1997).  As  Acting 
Comptroller  General  of  the  United  States 
James  F.  Hinchman  noted  (1997),  . .  im¬ 

proving  management  in  the  federal  sector 
will  be  no  easy  task,  but  GPRA  can  assist 
in  accomplishing  it.” 

Even  given  that  these  hurdles  are 
breached,  can  the  agencies  under  GPRA 
establish  a  system  flexible  enough  to 
counter  budget  turbulence  with  sufficient 
viable  contingency  plans  to  meet  legisla¬ 
tive  goals  (i.e.,  program  success)?  There 


is  still  some  concern  that  legislators  are 
lagging  in  their  understanding  of  GPRA 
and  their  role  in  its  promotion  (Laurent, 
1996).  As  reports  become  available  to  the 
public,  accountability  and  performance  of 
the  administration  and  Congress  will  be¬ 
come  very  visible  (Groszyk,  1995).  Both 
will  be  very 
hard  pressed  to 

fund  programs  "...  measuring  per- 
that  cannot  con-  lermanse  can  be- 
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1996).  Con- 1 
versely,  a  lack  | 
of  Congres¬ 
sional  interest  is 
likely  to  be  fatal 
(Groszyk, 

1995).  House 

Majority  Leader  Rep.  Dick  Armey,  speak¬ 
ing  before  the  House  Government  Reform 
and  Oversight  Committee  in  February 
1997,  urged  both  Democrats  and  Repub¬ 
licans  to  become  knowledgeable  and  to 
“...  show  a  willingness  to  reexamine  pet 
projects  with  an  ear  toward  objective  cred¬ 
ible  information  about  the  results  of  these 
programs.”  It  will  be  interesting  to  see  if 
members  of  Congress,  once  they  have  the 
necessary  information,  will  be  able  to 
make  hard  choices;  or  if  they  will  use  it  to 
increase  their  level  of  oversight  to  control 
administrative  action.  GPRA  could  stand 
in  stark  contrast  to  the  implementation  of 
the  National  Performance  Review  and  in 
turn,  could  create  conflicting  administra¬ 
tive  requirements  (Winchell,  1996).  In  any 
case,  GPRA  will  only  be  successful  if  it 
becomes  part  of  the  principles  and  prac¬ 
tice  of  everyday  managerial  routines 
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(Groszyk,  1995).  Only  the  future  will 
show  if  GPRA  will  result  in  any  real 
changes  becoming  embedded  in  our  cul¬ 
ture.  As  OSD  Comptroller  John  J.  Hambre 
stated  in  1993,  it  should  . .  be  more  than 


another  layer  of  reporting,  the  process 
must  be  integrated  with,  and  reflect  the 
expectations  of  [the]  planning  and  bud¬ 
getary  process.” 
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OPINION 


A  THEORETICAL  CONSIDERATION 
OF  ACQUISITION  REFORM 

Dr.  Deborah  F.  Frank 


The  federal  government  acquisition  process  is  continually  changing.  It  responds 
to  constant  shifts  in  national  and  international  situations.  Culver,  in  Federal 
Government  Procurement— An  Uncharted  Course  Through  Turbulent  Waters , 
gives  a  historical  perspective  of  the  U.S.  procurement  process,  from  colonial 
times  onward  (1 985).  It  reflects  continual  turbulence  and  attempts  to  adapt  to  a 
changing  environment.  Placed  in  historical  perspective,  today’s  reforms  continue 
the  trends  of  the  past  220  years. 

Acquisition  reform  is  today’s  hot  topic.  It’s  the  latest  effort  to  improve  the 
acquisition  system.  But  before  we  reform  it,  we  must  first  understand  why  we 
are  doing  so.  What  are  the  objectives?  Reform  for  whose  purposes?  Who  are 
the  reforms  for?  Whose  needs  does  the  system  currently  meet  and  hope  to 
meet?  What  realistic  alternatives  exist?  In  his  remarks  to  the  Industrial  College 
of  the  Armed  Forces,  Paul  G.  Kaminski  stated  that  acquisition  reform  ought  to 
make  us  more  efficient,  improve  our  business  practices,  and  allow  us  to  buy 
more  with  less  (1995). 

In  this  reform  process,  we  must  remember  the  forces  that  drive  the  current 
state  of  acquisition:  protect  military  uses  against  poor  workmanship,  protect 
the  public  against  fraud  and  abuse,  and  advance  certain  socioeconomic  goals. 
Given  the  objective  of  acquisition  reform  and  the  forces  that  drive  the  acquisition 
process,  it  is  no  wonder  the  reform  effort  evokes  such  discussion,  analysis, 
and  review. 


May  you  live  in  interesting  times . 

—Chinese  benediction 


We  are  in  a  time  of  reform.  Private 
industry  has  been  thrust  into  a 
global  marketplace  that  demands 
maximum  efficiency.  This  need  for  effi¬ 
ciency  has  resulted  in  a  recognition  and 


embrace  of  attempts  to  maximize  produc¬ 
tivity.  In  this  regard,  reengineering  has 
emerged  as  a  highly  successful  procedure 
to  maximize  organizational  productivity. 
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In  “Acquisition  Reform:  A  Mandate  for 
Change,”  former  Secretary  of  Defense 
William  Perry  (1994)  concludes  . .  DoD 
has  been  able  to  develop  and  acquire  the 
best  weapons  and  support  systems  in  the 
world.  DoD  and  contractor  personnel  ac¬ 
complished  this  feat  not  because  of  the 
(acquisition)  system,  but  in  spite  of  it.  And 
they  did  so  at  a  price  ...  the  nation  can  no 
longer  afford  to  pay . . ..” 

Recommendations  for  the  reform  of  the 
government’s  acquisition  process  are  gen¬ 
erally  directed  at  specific  elements  within 
the  system  (i.e.,  numbers  of  workers,  dol¬ 
lar  threshold  for  contracting,  use  of  stan¬ 
dard  items).  This  attempt  at  reform  of  iso¬ 
lated  elements  will  improve  the  acquisi¬ 
tion  system,  to  some  extent.  Yet  a  look  at 
other  organizations’  attempts  at  reform 
reflects  a  different  approach.  Although  the 
government  is  seriously  pursuing  acqui¬ 
sition  reform,  when  compared  to  other 
organizational  streamlining  efforts,  its 
approach  appears  limited  in  scope. 

The  current  government  acquisition 
reform  effort  seems  to  model  the  indus¬ 
trial  sector  effort  via  the  use  of 
reengineering.  But  if  we  consider  the  fed¬ 
eral  acquisition  process  against  a  theoreti¬ 
cal  construct  of  systems  theory,  we  can 
establish  that  factors  and  influences  exist 
for  government  that  are  absent  in  the  in¬ 
dustrial  sector.  These  factors  may  explain 
two  things:  why  reengineering  is  not 
working  as  quickly  in  government  as  in 
industry,  and  why  the  continual  parade  of 


acquisition  reform  efforts  over  time  has 
failed  to  “reform.” 

This  article  looks  at  the  current  acqui¬ 
sition  reform  effort.  We’ll  consider  the 
influence  of  the  industrial  reengineering 
movement  in  terms  of  the  attempt  to  ap¬ 
ply  that  process  to  government  acquisi¬ 
tion.  The  entire  process  will  be  viewed 
against  a  construct  of  system  theory  to 
assess  influences  that  might  exist  beyond 
the  reaches  of  the  current  acquisition  ef¬ 
fort. 

Play  It  Again,  Sam 


The  Military  Acquisition  Sub¬ 
committee  meets  this  morning  to 
begin  a  series  of  hearings  on  ac¬ 
quisition  policy  and  reform  and 
. . .  whether  we  can  really  do  it  at 
this  time.  One  could  argue  we 
have  been  attempting  to  reform 
the  acquisition  system  for  de¬ 
cades,  dating  all  the  way  back  to 
the  Hoover  Commission  on  up  to 
the  Packard  Commission  and  the 
Defense  Management  Review.  I 
am  encouraged  that  we  may  have 
an  opportunity  that  we  never  had 
before. 

— U.S.  Congress  (1994),  p.  1 

The  U.S.  acquisition  system  has  been 
burdened  with  many  obvious  criticisms 
for  years.  There  are  the  routinely  quoted 
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problems  of  contractor  overpricing  for 
simple  items.  There  is  the  common  per¬ 
ception  by  Americans  that  “the  govern¬ 
ment”  does  things  the  hard  way.  There  are 
also  the  more  obvious  signs  that  reflect  a 
concern  with  the  U.S.  acquisition  system. 
The  Comptroller  General  report,  “Weap¬ 
ons  Acquisition:  A  Rare  Opportunity  for 
Lasting  Change,”  verifies  that  almost  con¬ 
tinual  taskings  of  commissions  and  task 
forces  are  examining  the  system  to  deter¬ 
mine  problems  and  recommended  solu¬ 
tions  (Comptroller  General,  1990). 

The  National  Performance  Review  be¬ 
gan  in  1993  when  President  Bill  Clinton 
announced  a  six-month  review  of  the  fed¬ 
eral  government.  The  Report  of  the  Na¬ 
tional  Performance  Review  documented 
a  process  that  was  intended  to  change  fed¬ 
eral  government  operations.  The  process 
followed  a  logical  sequence  of  cutting  red 
tape,  putting  customers  first,  empowering 
employees,  and  getting  back  to  basics. 
This  reform  effort  has  taken  on  the  mantle 
of  reengineering,  with  the  intent  of  assess¬ 


ing  current  acquisition  processes  and  seek¬ 
ing  more  effective,  efficient  ways  of  do¬ 
ing  business. 

Reform  is  not  a  new  word  in  the  De¬ 
partment  of  Defense  (DoD)  vocabulary. 
Since  the  1950s  acquisition  reform  has 
been  attempted,  without  much  success. 
The  reform  efforts  of  the  sixties  were  ini¬ 
tiated  by  Robert  McNamara  in  an  attempt 
to  “fix”  the  procurement  system.  Table  1 
shows  there  has  been  a  series  of  reforms 
since  then  (McNaugher,  1990). 

Reforms  have  addressed  such  issues  as 
better  planning,  increased  centralization, 
simplified  reporting  chain,  better  cost  es¬ 
timates,  additional  executive-level  person¬ 
nel,  inclusion  of  the  Joint  Chiefs  of  Staff, 
increased  milestone  approvals,  and  fund¬ 
ing  and  program  stability.1  Yet  the  system 
resists  significant  change.  The  evolution 
of  the  “acquisition  reform  waterfall”  re¬ 
sults  from  the  lack  of  success.  Why  is  there 
a  continual  parade  of  reform  initiatives? 
Each  of  these  initiatives  has  championed 
sound  management,  but  failed  to  recog- 


Year 

Initiative 

1961 

McNamara  initiatives 

1970 

Fitzhugh  Commission 

1972 

Commission  on  Government  Procurement 

1976 

OMB  Circular  A-109 

1978 

Defense  Science  Board  Acquisition  Cycle  Study 

1979 

Defense  Resources  Management  Study 

1981 

Defense  Acquisition  Improvement  Program 

1983 

Grace  Commission 

1986 

Packard  Commission 

1986 

Goldwater  Nichols 

1989 

Defense  Management  Review 

Table  1.  Reform  Initiatives 
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nize  the  existence  of  the  “acquisition  cul¬ 
ture,”  the  environment  in  which  all  of  the 
participants  operate  (McNaugher,  1990,  p. 
188): 

Reformers  have  spent  a  good  deal 
of  time  and  effort  since  the  1950s 
trying  to  centralize,  simplify,  and 
stabilize  the  weapons  acquisition 
process.  Yet  the  process  somehow 
defies  centralization  and  stabili¬ 
zation,  and  if  anything  it  grows 
more  rather  than  less  complicated 
...  An  important  part  of  the  prob¬ 
lem  can  be  attributed  to  the  po¬ 
litical  milieu  in  which  reform  oc¬ 
curs. 

The  repudiation  of  past  reform  efforts 
does  not  end  there  (Gregory,  1 989,  p.  xii): 

Reform  of  weapon-acquisition 
systems  has  produced  precious 
little  by  way  of  improvement.  In¬ 
cessant  finger  pointing,  second- 
guessing,  scandal  brandishing, 
regulation  writing,  and  general 
viewing  with  alarm  have  pro¬ 
duced  an  atmosphere  of  dis¬ 
trust — hardly  conducive  to  get¬ 
ting  the  job  done.... 

Finally,  a  1986  survey  by  Arthur  D. 
Little  reported  that  there  is  a  perception 
that  the  acquisition  process  is  so  cumber¬ 
some  that  it  is  unlikely  that  it  can  ever 
function  in  its  present  form.  It  is  beyond 
repair  in  its  present  state.  To  succeed,  the 
reformers  must  not  only  recognize  this 
culture,  but  also  have  the  ability  to  effect 
change.  Despite  commissions  and  Con¬ 
gressional  interest  and  continual  DoD  di¬ 
rectives  and  changes,  the  U.S.  acquisition 


system  continues  to  function  under  a 
heavy  burden  of  regulation  and  bureau¬ 
cratic  inefficiencies.2 

Past  reform  efforts  were  instituted  on  a 
regular  basis.  Each  of  the  efforts  resulted 
in  additional  recommendations,  regula¬ 
tions,  and  personnel.  The  President’s  Blue 
Ribbon  Commission  on  Defense  Manage¬ 
ment  recognized  this  problem  (Gansler, 
1991,  p.  14): 

In  general  we  discovered  these 
problems  [acquisition  inefficien¬ 
cies]  were  seldom  the  result  of 
fraud  or  dishonesty.  Rather  they 
were  symptomatic  of  the  under¬ 
lying  problems  that  affect  the  en¬ 
tire  acquisition  system.  Ironically, 
actions  being  prescribed  in  law 
and  regulation  to  correct  [the 
problems]  tend  to  exacerbate  the 
underlying  issues  by  making  ac¬ 
quisition  procedures  even  more 
inflexible  and  by  removing  what¬ 
ever  motivation  exists  for  the  ex¬ 
ercise  of  individual  judgment. 

Yet  the  reform  parade  continues.  Evi¬ 
dently  the  results  of  the  reform  efforts  have 
not  effected  significant  or  lasting  or  ef¬ 
fective  or  desirable  change.  Some  point 
is  befing  missed,  the  source  of  the  prob¬ 
lem  is  not  being  addressed,  the  “easy” 
solutions  are  being  implemented.  Or  the 
real  problem  is  not  identified. 

The  problem  must  be  identified  and 
analyzed  in  a  different  fashion.  To  effect 
change  of  a  process,  to  alter  the  output  of 
product,  we  must  identify  the  inputs  to  that 
process.  By  identifying  inputs,  the  makeup 
of  the  process  can  be  clearly  analyzed  and 
a  better  understanding  of  its  rationale  can 
be  developed.  This  identification,  once 
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done,  can  suggest  which  inputs  should  be 
changed  or  if  they  can  be  changed.  With¬ 
out  assessing  inputs  that  make  up  an  out¬ 
put,  the  process  cannot  change. 


Change 


The  only  people  who  like  change 

are  wet  babies . 

—Sir  Brian  Wolfson 

The  federal  government  is  not  the  only 
institution  seeking  answers  on  how  best 
to  change.  American  companies  con¬ 
stantly  search  for  ways  to  improve  their 
operations.  Surveys  suggest  that  compa¬ 
nies  are  constantly  undertaking  programs, 
initiatives,  or  projects  to  improve  organi¬ 
zational  performance.  Of  200  companies 
in  a  recent  survey,  42%  initiated  11  or 
more  projects  within  the  past  five  years 
{Management  Review,  Spitzer  and  Tobia, 
1994).  This  validates  the  premise  that 
companies  are  willing  to  undergo  the  tur¬ 
bulence  of  change  in  search  of  improved 
performance,  profits,  and  worker  motiva¬ 
tion. 

Firms  create  advantage  by  discovering 
new  and  better  ways  to  compete  in  the 
industry  and  bring  it  to  market.  This  rep¬ 
resents  innovation,  including  improve¬ 
ments  in  technology  and  better  ways  of 
doing  things.  It  is  reflected  in  product  and 
process  change,  new  approaches  to  mar¬ 
keting,  and  new  forms  of  distribution.  This 
change  is  based  more  on  an  accumulation 
of  small  insights  than  on  technological 
breakthroughs. 

Change  is  difficult.  In  a  corporation 
there  will  be  any  number  of  “customers” 
who  will  resist  the  change.  Many  parties— 


stockholders,  the  board  of  directors,  ven¬ 
dors,  management,  public  relations — have 
a  vested  interest  in  maintaining  the  sys¬ 
tem  as  it  is,  for  any  number  of  reasons. 
Manganelli  and  Klein  (1994)  maintain  that 
change  within  an  organization  must  be 
mandated  by  senior  management,  at  the 
least,  and  “worked”  with  the  customers, 
at  least  those  maintaining  power  within 
the  organization.  They,  like  Hammer  and 
Champy  (1993),  also  stress  the  “rapid”  and 
“radical”  approach  to  business  reengi¬ 
neering.  They  assert  that  anything  less  will 
result  in  failed  improvement  programs. 


A  Theoretical  Consideration _ 

An  analysis  of  this  subject  must  be 
based  on  an  understanding  of  a  theory  that 
is  applicable  to  its  structure,  process,  or 
operational  mode.  This  allows  us  to  ap¬ 
preciate  the  current  situation,  variables 
that  may  influence  the  subject,  and  we  may 
have  the  basis  for  some  projections.  To 
logically  analyze  a  system  or  process,  it 
must  be  placed  against  a  theoretical  frame¬ 
work.  In  this  fashion,  aspects  of  opera¬ 
tional  system  can  be  more  thoroughly 
studied  and  projections  can  be  made  based 
on  definable  data. 

I  believe  that  a  theoretical  assessment 
of  a  problem  is  necessary  before  one  can 
propose  effective  alternative  solutions.  A 
look  at  the  current  acquisition  process 
against  a  theoretical  framework  will  help 
us  understand  process  flow  and  give  us 
an  opportunity  to  consider  possible  inputs 
and  outputs.  We  will  therefore  have  a  bet¬ 
ter  understanding  of  the  forces  that  drive 
a  process,  and  in  turn,  the  results  of  that 
process. 
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Systems  Approach  (What  Goes  In 
Must  Come  Out) 


The  system  theory  is  a  rather  basic  pro¬ 
cess  presuming  that,  with  certain  input, 
there  is  a  certain,  predictable  output.  The 
same  input  will  continue  to  result  in  the 
same  output  unless  there  is  some  disrup¬ 
tion  to  the  process.  That  is,  unless  other 
inputs  change  or  interact  in  a  different 
fashion. 

Beishon  and  Peters  state  that  “the  sys¬ 
tems  approach  has  been  adopted  by  so¬ 
cial  psychologists  as  a  basis  for  studying 
organizations.”  According  to  these  au¬ 
thors,  there  is  an  increasing  trend  in  adapt¬ 
ing  the  systems  approach  to  organizational 
theory  and  management  practices.  This 

adaptation  does 

"The  system  theory  not  PurP°«  to 

is  a  rather  basic  display  an  ex¬ 
process  presuming  haustive  analy- 

that,  with  certain  sis  of  the  man- 

input,  there  is  a  agement  prac- 

certain,  predictable  tice;  rather,  it 

output."  provides  an  il- 

lustration  that 

will  assist  in  analysis  and  evaluation. 

Emery  (1969)  states  that  “the  essential 
characteristic  of  a  system  is  that  it  is  com¬ 
posed  of  interacting  parts,  each  of  which 
has  interest  in  its  own  right.”  This  is  the 
key  to  the  systems  theory  and  the  key  to 
this  analysis  on  acquisition  reform.  Em¬ 
ery  continues  that  the  interacting  parts  are 
the  significant  factor  in  this  theory  and  in¬ 
fluence  the  behavior  of  the  system.  A  given 
system  component  transforms  inputs  into 
outputs,  presumably  contributing  to  the 
accomplishment  of  a  desired  purpose  of 
the  system. 

What  are  the  inputs  to  our  acquisition 
system?  Can  we  define  the  elements  that 


make  the  U.S.  acquisition  system  unique? 
'  In  the  quest  for  more  efficiency,  other 
countries  have  assessed  inputs  to  their  ac¬ 
quisition  systems  and  altered  inputs  as 
necessary.  Houston  (1994)  states  that  these 
efforts  have  resulted  in  more  efficient  and 
effective  acquisition  processes.  These 
studies  focus  on  government  control,  bud¬ 
getary  process,  workforce  training,  rela¬ 
tionships  with  contractors,  and  legislative 
oversight.  These  factors  are  some  of  the 
key  drivers  in  the  definition  of  a  unique 
acquisition  system. 

The  Comptroller  General  report  ( 1 990) 
concludes  that  an  “acquisition  culture” 
exists  throughout  DoD. 

This  culture  can  be  defined  as  be¬ 
havior  ...  of  participants  in  the  ac¬ 
quisition  process  DoD  and  Con¬ 
gress — and  forces  motivating  be¬ 
havior.  The  process  is  an  interac¬ 
tion  of  participants  rather  than 
methodological  procedure. 

Given  this  acquisition  culture,  partici¬ 
pants  operate  within  its  formal  and  infor¬ 
mal  rules  and  expectations.  Roles  and 
rules  are  defined;  the  importance  of  win¬ 
ning  is  understood.  Program  survival  is 
intertwined  with  participants’  needs — all 
participants.  These  include  the  military 
services  and  the  Office  of  the  Secretary 
of  Defense  (OSD),  which  feel  a  need  to 
perpetuate  a  mission;  contractors,  who 
want  to  sustain  business  and  acquire  prof¬ 
its;  overseeing  organizations,  which  want 
to  find  and  fix  problems;  Congress,  which 
needs  to  satisfy  the  public  (and  individual 
members,  their  constituencies);  and  pro¬ 
gram  managers,  who  want  to  maintain  or 
enhance  their  reputations.  To  further  com¬ 
plicate  the  culture,  the  short-term  involve- 
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ment  of  many  participants  encourages  short¬ 
term  payoffs. 

The  integrated  management  framework 
is  an  interchange  of  the  three  functions  of 
budgeting,  acquisition,  and  requirements. 
These  functions  give  customers  from  dif¬ 
ferent  arenas  (Congress,  the  services, 
regulatory  agencies,  and  OSD)  an  oppor¬ 
tunity  to  play  in  the  acquisition  process. 
Each  player  brings  his  own  agenda  and 
has  the  power  to  influence  the  operation 
of  the  acquisition.  Our  acquisition  system 
reflects  the  government  and  political  sys¬ 
tems  in  which  it  exists. 

All  systems  have  certain  inputs  that 
contribute  to  the  peculiar  system  that  re¬ 
sults.  These  inputs  include  such  diverse 
elements  as  cultural  expectations,  regula¬ 
tory  requirements,  customers  and  stake¬ 
holders,  budgetary  processes,  and  politi¬ 
cal  pressures.  I  will  explore  the  U.S.  ac¬ 
quisition  system  in  light  of  a  systems 
theory,  which  will  shed  light  on  its 
strengths  and  weaknesses,  and  help  define 
the  parameters  that  must  be  considered  in 
acquisition  reform. 

Given  a  systems  theory  and  a  general 
understanding  of  the  key  factors  (inputs) 
in  an  acquisition  system,  what  now?  If  we 
are  so  anxious  to  improve  our  acquisition 
system,  a  serious  effort  can  be  made  to 
adjust  input  and  environment  to  create  a 
more  efficient,  effective  organization. 


The  System  Works! 


The  problem  is,  simply,  that  the  current 
acquisition  system  works.  Given  a  paro¬ 
chial  view  of  the  acquisition  system  in 
terms  of  efficiency  and  effectiveness,  it 
certainly  has  its  problems.  This  is  routinely 
recognized  and  documented;  there  is  no 


need  to  pursue  that  avenue  here.  But  when 
viewed  from  the  larger  perspective,  and 
when  one  considers  the  many  players  in 
the  acquisition  process,  the  system  is  suc¬ 
cessful  for  the  customers.  Significant 
changes  will  affect  these  players  (who 
have  considerable  power),  and  they  may 
be  reluctant  to  embrace  another  system. 

The  “success”  of  the  system  is  well 
documented.  Some  express  concerns  that 
certain  customers,  small  businesses,  mi¬ 
nority  contractors,  and  suppliers  profit 
from  the  current  system,  and  thus  may  at¬ 
tempt  to  derail  efforts  at  acquisition  re¬ 


form.  But  the 

point  here  is  not  «rhe  integrated 
limited  to  profi-  management  frame* 
teering.  These  werk  is  an  infer* 
players,  as  well  change  of  the  three 
as  many  others,  functions  of  budget- 
have  estab-  Ing,  acquisition,  and 
lished  them-  requirements." 
selves  in  an  ac- 

mmition  svstem  that  provides  status. 


power,  influence,  and  opportunities  for 
success,  as  well  as  financial  rewards.  The 
system  works  for  them  and  they  will  re¬ 
sist  change  that  alters  this  type  of  return. 

Forman  puts  forth  an  interesting  propo¬ 
sition  in  “Wanted:  A  Constituency  for 


Acquisition  Reform”  (1994).  She  asserts 
that  there  are  continuing  calls  for  reform 
from  all  arenas;  all  parties  agree  that  the 
acquisition  process  is  inefficient.  But  the 
reason  our  system  has  not  been  changed 
is  because  the  system  is  working  the  way 
its  customers  want  it  to. 

The  military  are  the  most  visible  cus¬ 
tomers.  Given  the  current  system,  their 
influence  and  power  are  allowed  to  ex¬ 
pand.  Each  service  controls  its  own  des¬ 
tiny  by  controlling  its  own  acquisition. 
Defense  contractors  are  also  very  inter- 
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ested  in  maintaining  a  system  in  which 
they  can  sustain  operations  as  well  as 
make  profits.  Any  changes  in  the  acquisi¬ 
tion  system  may  modify  this  capability. 
Another  customer  is  the  Congress.  Given 
the  current  process,  members  of  Congress 
can  influence  military  acquisition  pro¬ 
grams  and  provide  jobs  for  their  states' 
citizens.  Additionally,  they  may  appear  in 
the  role  of  reformer  in  their  efforts  to 
“clean  up  the  system.”  The  media  also 
benefits  from  the  current  system  by  grand- 
standing  any  actual  or  perceived  problem 
in  the  system,  alerting  the  public  to  fraud, 
waste,  and  abuse.  Small  business  is  also 
comfortable  with  the  system  in  its  assurance 
of  continuing  awards  for  their  markets. 

Considering  these  inputs  to  our  acqui¬ 
sition  system,  one  can  see  that  the  call  for 

reform  must  be 
supported  by  a 
diversity  of  cus¬ 
tomers  so  as  to 
overcome  these 
vested  interests. 
Forman  main¬ 
tains  that  any 
change  to  the 
acquisition  process  must  overcome  these 
entrenched  areas  first.  Acquisition  reform 
advocates  also  recognize  this  dilemma. 
Many  authors  have  expressed  concern  re¬ 
garding  the  entrenched  interests  of  spe¬ 
cial  interests  such  as  small  business,  mi¬ 
nority  contractors,  suppliers,  media  and 
others  that  profit  from  the  current  system. 

A  recent  Government  Accounting  Of¬ 
fice  (GAO)  report  suggests  that  acquisi¬ 
tion  funds  are  among  the  most  discretion¬ 
ary  in  the  DoD  budget.  This  sole  factor 
must  make  these  funds  particularly  appeal¬ 
ing  to  politicians,  whose  existence  is  de¬ 
termined  by  constituents,  and  whose  elec¬ 


"A  larger,  more 
potent  factor 
emerges  that  influ¬ 
ences,  indeed  con¬ 
trols,  the  acquisition 
process— politics." 


tions  are  supported  by  powerful  lobbyists 
and  political  action  committees,  which 
often  represent  defense  contractors.  This 
relationship  involves  politicians  in  the 
acquisition  process.  Add  to  that  formula 
the  distasteful  downsizing  and  decrease  of 
the  defense  budget — where  more  hands 
chase  fewer  dollars. 


Politics 


In  the  above  discussion  it  becomes  ap¬ 
parent  that  inputs  to  the  acquisition  pro¬ 
cess  cannot  be  readily  changed.  The  pro¬ 
cess  is  meeting  the  needs  of  those  in¬ 
volved.  A  larger,  more  potent  factor 
emerges  that  influences,  indeed  controls, 
the  acquisition  process — politics.  This 
author  believes  that  the  political  environ¬ 
ment  is  a  critical  factor  in  the  acquisition 
process.  To  modify  the  defense  acquisi¬ 
tion  process,  one  must  consider  the  role 
of  politics.  An  attempt  to  influence  the 
current  process  without  assessing  politi¬ 
cal  influence  will  fail. 

Political  involvement  in  the  acquisition 
process  began  220  years  ago.  Congress 
received  virtually  every  power  over  the 
budget  via  Article  I  of  the  Constitution. 
Since  that  beginning,  the  involvement  of 
Congress  within  the  DoD  budgeting  and 
acquisition  cycle  has  increased.3  The  re¬ 
sult  of  this  evolution  is  that  Congress  is 
increasingly  involved  in  defense  budget 
details.  In  the  period  from  1980  to  1990, 
the  number  of  line  item  changes  made  by 
Congress  in  the  Defense  budget  rose  from 
1,500  to  more  than  2,500.  The  effect  of 
this  degree  of  micromanagement  is  that 
Congress  decides  what  programs  are 
killed,  supported,  or  modified.  This  feeds 
the  Congressional  need  to  “feed”  its  con- 
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stituents.  A  telling  comment  by  a  member 
of  Congress  summed  up  the  acquisition 
reform  problem.  “We  can’t  reform  the 
Pentagon  until  we  reform  ourselves.”4 

The  increasing  degree  of  political  in¬ 
volvement  is  obvious  in  the  changesto  the 
DoD  budget  request  between  funding  re¬ 
quested  by  the  military  and  the  amounts 
appropriated  by  Congress  (Table  2) 
(Comptroller  General,  1990).  This  re¬ 
quirement  for  increased  visibility  demon¬ 
strates  the  ever-growing  interest  and  in¬ 
volvement  of  the  political  system  in  the 
federal  acquisition  process.  By  maintain¬ 
ing  visibility,  Congress  can  more  easily 
influence,  and  possibly  control,  decision 
making  and  funding  distribution  (Adelman 
and  Augustine,  1990).5 

A  recent  example  of  the  political  influ¬ 
ence  on  the  acquisition  process  is  reflected 
in  the  reform  process  itself.  DoD  designed 
a  far-reaching  acquisition  reform  proposal. 
Although  it  reflected  an  ambitious  effort 
for  acquisition  reform,  it  attempted  to 
eliminate  too  much  (politically)  in  the  way 
of  social  regulation.  This  proved  to  be  po¬ 
litically  unacceptable.  An  acquisition  re¬ 
form  bill  was  passed,  but  it  was  not  as 


ambitious  as  the  proposal  supported  by 
DoD. 

Another  significant  political  influence 
on  the  acquisition  process  is  the  Defense 
budget.  The  current  decreasing  trend  in  the 
size  of  the  budget  suggests  that  congres¬ 
sional  representatives  will  attempt  to 
maintain  or  even  increase  their  influence 
over  the  acquisition  process.  The  signifi¬ 
cant  changes  in  the  budget  are  reflected 
in  Table  3  (Schick,  1995). 

These  Congressional  issues  affect  the 
defense  acquisition  process.  Intervention 
by  the  legislative  and  executive  branches 
of  the  government  may  meet  their  needs — 
political,  economic,  or  social — but  the  re¬ 
sult  for  the  acquisition  process  is  constant 
turbulence.  This  turbulence  is  a  critical 
factor  in  decreasing  the  management  ca¬ 
pabilities  at  the  appropriate  levels.  This 
in  turn  feeds  the  perception  that  program 
managers  cannot  manage  their  programs, 
in  turn  feeding  the  perception  that  higher 
level  managerial  “help”  is  needed.  Norm 
Augustine  contends  that  “turbulence  in  the 
defense  acquisition  management  process 
must  be  eliminated”  (Adelman  and  Au¬ 
gustine,  1990). 


Year 

Auth 

Appro 

Total 

1980 

300 

1200 

1500 

1982 

350 

1200 

1550 

1984 

900 

1500 

2400 

1986 

1350 

1800 

3150 

1988 

1250 

1700 

2950 

1990 

1150 

1350 

2500 

Source:  Comptroller  General  of  the  United  States  ( 1990). 

Table  2.  Congressional  Changes  to  DoD  Budget  Request 
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Year 

Outlay 
FY87$  (B) 

Percent 

Change 

Defense 

Percent 

1960 

220 

52 

1965 

204 

-7 

43 

1970 

263 

29 

42 

1975 

184 

430 

26 

1980 

187 

2 

23 

1985 

261 

40 

27 

1990 

273 

5 

24 

1995 

207 

-2  4 

18 

1999* 

175 

-16 

14 

*  Projected 

Source:  Schick,  A.  (1995). 

Table  3.  Defense  Outlays  and  Percentage  of  Total  Outlay 


The  ever-increasing  Congressional  in¬ 
terest  in  terms  of  micro-management,  bud¬ 
get,  and  political  concerns  remains  a  grow¬ 
ing  issue.  This  Congressional  oversight  is 
a  critical  input  in  the  acquisition  process. 
This  influence  affects  and  in  some  respects 
controls  the  acquisition  process.  This 
micromanagement  is  increasing  while 
calls  for  acquisition  reform  and  simplifi¬ 
cation  and  reengineering  continue;  but 
increasing  Congressional  management 
and  acquisition  reform  are  irreconcilable 
goals. 

In  a  consideration  of  the  systems  theory 
applied  to  the  acquisition  process,  politi¬ 
cal  interests  are  a  major  input.  The  politi¬ 
cal  influence  affects  the  acquisition  pro¬ 
cess.  This  political  input  affects  all  activ¬ 
ity  and  introduces  a  culture  that  must  be 
understood  to  appreciate  the  acquisition 
process.  The  system  cannot  be  changed 
unless  the  inputs  are  changed. 


Obviously  some  of  the  inputs  into  the 
system  are  more  influential  than  others. 
Based  on  the  power  of  political  input — 
its  control  of  regulation,  budget,  report¬ 
ing,  and  approval — it  is  the  most  influen¬ 
tial  in  shaping  the  acquisition  process.  Any 
reform  of  this  acquisition  process  should 
consider  this  input  and  acknowledge  its 
influence  of  the  system. 

Our  political  system  is  structured  so  that 
competing  branches  of  government  inter¬ 
sect  with  one  another.  Originally  instituted 
as  a  system  of  checks  and  balances,  these 
branches  of  government  hamper  effi¬ 
ciency  and  reform.  Managerial  reform  ef¬ 
forts  are  complicated,  and  possibly  con¬ 
voluted,  by  the  interaction  of  the  political 
system.  So  any  attempt  for  centralization 
within  one  branch  of  the  government  is 
fought  by  one  of  the  other  branches.  Simi¬ 
larly,  any  reform  effort  to  minimize  po¬ 
litical  influence  in  the  acquisition  system 
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will  be  fought  by  the  branches  of  the  gov¬ 
ernment. 

The  costs  of  politicization  have 
been  high.  Increasingly  domi¬ 
nated  by  the  short-term  perspec¬ 
tive  of  the  political  process,  the 
acquisition  process  makes  basic 
mistakes  in  the  allocation  of  re¬ 
sources  to  research  and  develop¬ 
ment,  where  a  long-term  perspec¬ 
tive  is  required,  increasingly 
dominated  by  the  pork-barrel  de¬ 
cision  rules  of  American  politics 
. . .  where  flexibility  and  decisive¬ 
ness  are  required. 

McNaugher  (1989,  p.  15)  goes  on  to 
assert  that  “effective  reform  would  require 
fundamental  change  in  the  relationship 
between  the  political  system  and  the  ac¬ 
quisition  process.” 

Reforming  the  Reform  Process 


Osborne  and  Gaebler  (1992)  say  that, 
to  reinvent  government,  the  incentives  that 
drive  public  institutions  must  be  changed. 
An  analysis  must  be  performed  on  the  in¬ 
stitution  to  assess  what  elements  of  the 
market  need  to  be  improved  to  make  it 
work. 

Political  influence  must  be  acknowl¬ 
edged  in  the  acquisition  reform  process. 
Politics  is  the  environment  within  which 
the  process  functions.  Unless  the  political 
influence  is  acknowledged,  no  significant, 
lasting  change  can  be  made.  This  includes 
Congressional  interest  of  all  types,  bud¬ 
get  controls,  reporting  requirements,  con¬ 
stituent  interest,  and  contractor  interest. 
These  are  powerful  influences. 


The  United  States  could  also  modify  its 
acquisition  system.  But  any  modification, 
however  small  or  large,  would  require  the 
support  and  approval  of  the  “customers 
who  provide  the  input  to  the  process.  The 
change  will  be  neither  easy  nor  comfort¬ 
able  for  the  parties  involved.  Reform 
would  require  a  change  in  the  inputs  to 
the  acquisition  process;  a  change  in  the 
relationship  between  customers  and  the 
acquisition  process.  Most  significantly,  re¬ 
form  would  require  a  change  in  the  rela¬ 
tionship  between  the  political  system  and 
the  acquisition  process. 

The  critical  change  would  be  the  po¬ 
litical  dimension.  Intensive  Congressional 
micromanagement  influences  the  federal 
acquisition  process.  This  control  causes 
delay  and  risk-aversive  actions  on  the  part 
of  those  who  are  responsible — the  pro¬ 
gram  managers. 

Gregory  (1989)  discusses  this  increased 
involvement  by  Congress.  He  says  that  the 
role  of  Con¬ 
gress  should  be 

that  of  a  board  "Political  influence 

of  directors,  not  must  be  acknowl- 
managers.  But  edged  in  the  acnuisi- 

Congress  has  «•»  9—™-” 

become  so  in- ; 
volved  in  the 

acquisition  process  that  it  has  lost  its  ob¬ 
jectivity  as  a  reviewing  authority.  Until 
Congress  recognizes  this  conflict  and  re¬ 
moves  itself  from  acquisition  manage¬ 
ment,  the  problem  will  continue.  Thus,  this 
one  significant  input  into  the  acquisition 
system  will  continue  making  real  reform 
impossible. 

There  appears  to  be  a  consensus  that 
the  acquisition  reform  process  must  ad¬ 
dress  all  factors  influencing  the  output. 
Additionally,  one  must  face  the  political 
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environment  that  so  heavily  influences  the 
acquisition  process.  If  changes  are  not 
made  to  the  political  aspect,  then,  based 
on  the  history  of  acquisition  reform,  we 
can  probably  assume  that  changes  made 
to  other  inputs  will  result  in  a  marginal 
return.  Corporate  America  has  effectively 
used  the  reengineering  process  to  intro¬ 
duce  needed  innovations.  But  reengi¬ 
neering  has  the  ability  to  effect  change  to 
all  necessary  inputs  in  the  corporate  world. 
I  do  not  believe  this  to  be  true  in  the  fed¬ 
eral  acquisition  process.  Politics  cannot  be 
ignored  as  a  critical  factor  in  the  acquisi¬ 
tion  game.  The  theoretical  structure  of  the 
system,  with  its  second-  and  third-order 
effects,  must  be  recognized  before  any 
meaningful  change  can  take  place. 
McNaugher  (1989,  p.  86)  reaches  this 
same  conclusion. 


It  remains  to  be  seen  whether 
some  reforms  might  succeed 
where  others  so  far  have  failed. 
Clearly,  however,  far  more  radi¬ 
cal  reorganization  is  in  order,  a 
reorganization  that  basically  al¬ 
ters  the  relationship  between  the 
political  system  and  the  acquisi¬ 
tion  process.  As  troubled  as  poli¬ 
ticians  may  be  by  features  of  the 
acquisition  process,  the  political 
system  as  a  whole  has  so  far  been 
unwilling  to  contemplate  change 
this  great.  Reluctance  is  not  sur¬ 
prising;  a  political  system  accus¬ 
tomed  to  muddling  through  will 
probably  engage  in  radical  reform 
only  in  response  to  massive  fail¬ 
ure.  And  the  fact  is,  the  failures 
of  the  acquisition  process  tend  to 
appear  on  the  margins. 
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Endnotes 


1 .  In  1985,  in  response  to  media  accounts 
of  fraud,  waste,  and  abuse,  the  Presi¬ 
dent  established  the  Blue  Ribbon 
Commission  on  Defense  Manage¬ 
ment.  The  major  recommendations  of 
the  commission  were:  the  establish¬ 
ment  of  an  Under  Secretary  of  De¬ 
fense  for  Acquisition,  the  establish¬ 
ment  of  a  service  acquisition  execu¬ 
tive  for  each  service,  and  the  appoint¬ 
ment  of  program  executive  officers. 
All  recommendations  were  aimed  at 
DoD’s  management  policies  and  pro¬ 
cedures. 

2.  McNaugher  discusses,  in  detail,  re¬ 
form  attempts  since  McNamara.  In 
summary,  the  results  of  reform  have 
led  to  an  imposition  of  political  val¬ 
ues  on  the  weapons  development  pro¬ 
cess.  He  concludes  that  reform  efforts 
have  been  counterproductive. 


3.  Shilman  (1988)  discusses  the  history 
of  the  Congressional  budget  process, 
its  evolution,  and  current  status. 

4.  Wildavsky  ( 1 987)  reviews  the  current 
Congressional  committee  structure 
and  discusses  how  this  structure  con¬ 
tributes  even  further  to  the  involve¬ 
ment  of  Congress  in  the  DoD  budget 
and  acquisition  process. 

5.  Adelman  and  Augustine  discuss  the 
defense  procurement  mess  that  results 
from  Congressional  microman¬ 
agement.  They  provide  examples  that 
show  this  to  be  an  increasing  trend. 
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TUTORIAL 


THE  DEFENSE  ACQUISITION 
WORKFORCE  IMPROVEMENT  ACT: 
FIVE  YEARS  LATER 

Andrea  Garda,  Hugo  Keyner,  Thomas  J.  Robillard, 
and  Mary  VanMullekom 


DAWIA  was  enacted  five  years  ago,  and  the  following  selective  assessment 
finds  that  progress  has  been  made.  The  authors  review  the  changes  made  to 
achieve  the  goals  outlined  in  the  legislation,  and  focus  on  several  areas  that 
remain  to  be  addressed,  in  order  to  carry  out  the  intent  of  the  law. 


The  Defense  Acquisition  Workforce 
Improvement  Act  (DAWIA),  Public 
Law  101-510,  Title  10  U.S.C.1,  was 
enacted  to  improve  the  effectiveness  of 
the  personnel  who  manage  and  implement 
defense  acquisition  programs.  As  part  of 
the  fiscal  year  1991  Defense  Authoriza¬ 
tion  Act,  it  called  for  establishing  an  Ac¬ 
quisition  Corps  and  professionalizing  the 
acquisition  workforce  through  education, 
training,  and  work  experience.  While  the 
Act  applied  to  both  civilian  and  military 
personnel,  it  emphasized  the  need  to  of¬ 
fer  civilians  greater  opportunities  for  pro¬ 
fessional  development  and  advancement. 

This  study  examines  the  state  of  de¬ 
fense  acquisition  workforce  management 
five  years  after  the  law  was  enacted.  We 
will  not  provide  a  comprehensive  review 
of  DAWIA  implementation  throughout 


the  entire  Department  of  Defense  (DoD), 
but  will  instead  focus  on  selected  areas. 
We  look  across  military  departments  and 
defense  agencies  to  compare  and  contrast 
their  policies  and  procedures  regarding 
how  they  manage  their  acquisition 
workforce.  The  primary  focus  is  on  issues 
pertaining  to  civilians,  since  they  make 
up  the  majority  of  the  defense  acquisition 
workforce  and  are  a  special  emphasis  area 
in  DAWIA. 

We  found  much  progress  has  been 
made  over  the  past  five  years,  and  the 
DoD  Components2  have  achieved  signifi¬ 
cant  gains  in  improving  the  quality  of  their 
acquisition  workforce.  But  more  remains 
to  be  done.  Our  analysis  shows  that  two 
main  areas  need  improvement:  diversity 
of  policies  and  practices,  and  disparity 
between  civilian  and  military  opportuni- 
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ties.  This  paper  provides  data  to  support  workforce,4  and  each  has  established  man- 
these  two  findings  and  offers  some  strat-  agement  information  systems  to  track  de- 
egies  to  overcome  them.  mographics,  training,  career  progression, 

and  other  variables.  In  addition,  each  com¬ 
ponent  has  reduced  turnover  of  incum- 
PlVERSITY  OF  POLICY  AND  PRACTICE _  bents  in  senior  acquisition  positions,  in¬ 

creased  representation  of  civilians  in  some 
DAWIA  expressly  calls  for  uniformity  senior  acquisition  positions,  and  devel- 
in  implementation  throughout  the  Depart-  oped  procedures  to  provide  for  the  selec- 
ment  of  Defense,3  In  general,  DoD  Com-  tion  of  best  qualified  individuals, 
ponents  have  been  consistent  in  their  com-  In  short,  all  have  complied  with  the 
pliance  with  the  major  provisions  of  the  broad  requirements  of  DAWIA.  But  when 
law.  For  example,  each  has  established  an  one  looks  at  the  specific  policies  and  prac- 
acquisition  corps,  identified  critical  acqui-  tices  of  each  DoD  Component,  there  is 
sition  positions,  and  enhanced  profes-  considerable  variation  between  them.  We 

sional  development  of  its  acquisition  per-  found  the  Components  differ  in  their  Ac- 

sonnel  through  education,  training,  and  quisition  Corps  membership  criteria,  mo- 
work  experience.  Each  has  appointed  a  bility  requirements,  and  centralized  refer- 
director  for  acquisition  career  manage-  ral  systems.  The  differences  are  described 
ment  (DACM)  to  manage  the  acquisition  in  the  following  paragraphs. 


Andrea  Garcia  is  a  professor  at  the  Defense  Systems  Management  College.  Prior  to  that,  she 
spent  17  years  as  an  Army  civilian  in  a  variety  of  acquisition  positions.  She  is  a  graduate  of 
DSMC’s  Program  Management  Course  and  the  industrial  College  of  the  Armed  Forces.  She 
also  holds  a  Master  of  Public  Administration  from  George  Washington  University  and  a  B.S. 
degree  in  education  from  the  University  of  Maryland. 

Col.  Hugo  Keyner  is  the  Director  for  Defense  Cooperation  in  Armaments,  Joint  U.S.  Military 
Affairs  Group[n]Korea  working  multi-service  international  cooperative  research  and  develop¬ 
ment  technology  programs.  He  is  a  graduate  of  DSMC’s  APMC  90-1,  the  Defense  Acquisition 
University’s  Senior  Acquisition  Course,  and  the  Industrial  College  of  the  Armed  Forces.  He  holds 
an  M.S.  degree  in  national  resource  strategy  from  National  Defense  University. 

Thomas  Robillard  is  the  Department  of  Defense  National  Airspace  System  program  manager. 
He  has  been  a  deputy  program  director  for  Joint  STARS,  chief  of  programs,  and  worked  as  a 
cost  analyst/chief  of  program  control.  Robillard  is  a  graduate  of  DSMC’s  Program  Management 
Course,  the  Industrial  College  of  the  Armed  Forces,  and  the  Senior  Executive  Fellows  Program 
at  John  F.  Kennedy  School  of  Government. 

Mary  VanMullekom  is  currently  a  branch  head  of  the  Working  Capital  Fund  for  the  Depot  Main¬ 
tenance  Business  Area  at  Headquarters  Marine  Corps,  Installations  and  Logistics  Department, 
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Eligibility  Criteria  for  Acquisition 
Corps  Membership 

DAWIA  calls  for  each  military  depart¬ 
ment  to  establish  an  Acquisition  Corps 
and  specifies  eligibility  criteria  for  mem¬ 
bership.  According  to  the  law,  Acquisi¬ 
tion  Corps  membership  is  limited  to  ci¬ 
vilians  holding  positions  at  GS-13  or 
above  and  military  at  the  rank  of  major/ 
lieutenant  commander  or  above.  In  addi¬ 
tion,  membership  is  limited  to  persons 
having  a  college  degree,  with  at  least  24 
semester  credit  hours  of  business  manage¬ 
ment,  and  at  least  four  years  of  acquisi¬ 
tion  work  experience.  Military  depart¬ 
ments  are  allowed  to  grant  waivers  to 
these  provisions  and  to  impose  additional 
eligibility  requirements.6 

In  addition  to  establishing  standards 
and  developing  skills  for  acquisition  pro¬ 
fessionals,  DAWIA  was  intended  to  en¬ 
sure  that  the  best  qualified  people  were 
selected  for  acquisition  positions.7  What 
approach  does  each  department  take  to 
ensure  the  “best  qualified  individual”  is 
selected  for  a  vacant  acquisition  position? 
Each  department  has  published  literature 
covering  the  DAWIA  criteria  for  staffing 
and  training  purposes.  In  the  Department 
of  the  Navy  (DoN),  for  example,  all  ci¬ 
vilian  Critical  Acquisition  Positions 
(CAPS)  must  be  advertised  at  least  within 
the  department  and  must  include  DAWIA 
criteria  (i.e.  Acquisition  Professional 
Community8  criteria)  in  the  rating  and 
ranking  of  candidates.  The  rating  and 
ranking,  of  course,  is  based  (among  other 
things)  on  whether  an  individual  is  certi¬ 
fied  as  an  acquisition  professional  and  the 
level  of  certification  he  or  she  possesses. 
And,  yes,  all  Defense  Components  rec¬ 
ognize  DoN  certification,  just  as  DoN  rec¬ 


ognizes  certification  granted  by  the  Army, 
Air  Force,  and  other  DoD  Components.9 
If  that  is  the  case,  and  there  is  full  reci¬ 
procity  between  them,  are  certification 
requirements  and  criteria  uniform  across 
the  DoD  Components?  Not  exactly! 

DoD  Components  have  established 
generally  similar  requirements  for  Acqui¬ 
sition  Corps  membership.  All  comply  with 
the  law  and  fol- 

low  the  educa-  :  addition  to 

tion,  training,  establishing  clan- 
and  experience  dards  and  develop- 
requirements  ing  skills  for  acquisi- 
contained  in  tion  professionals, 
DoD  Manual  1  DAWIA  was  intended 


5000.52M  for  »o  ensure  that  the 

certification  at  *****  qw*IM**4 
basic,  interne-  P**P**  were  se- 

.  ,  tested  for  acquisition 

diate  and  ad-  ,tion^„ 

vanced  levels 
(Levels  I,  II  and 

III).  Components  vary,  however,  in  some 
policies  regarding  Acquisition  Corps 
membership  for  civilian  personnel. 

First,  the  Navy  more  narrowly  defines 
its  Acquisition  Professional  Community 
than  the  other  services.  For  example,  only 
select  portions  of  the  Comptroller  career 
field  are  APC  members:  business  and  fi¬ 
nancial  managers  in  program  manage¬ 
ment  offices,  cost  estimators  in  systems 
commands,  and  cost  schedule  control  per¬ 
formance  evaluators. 


Another  difference  is  the  requirement 
for  incumbency  in  an  acquisition  position. 
As  a  general  rule,  the  Army  and  Navy  re¬ 
quire  that  civilians  be  in  designated  ac¬ 
quisition  positions  when  applying  for 
membership  in  the  Acquisition  Corps. 
Thus,  they  normally  do  not  certify  an  in¬ 
dividual  who  is  not  occupying  an  acqui- 
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sition  billet,  regardless  of  his  or  her  pro¬ 
fessional  qualifications.  Consequently, 
personnel  who  otherwise  meet  the  quali¬ 


fications  for  certification  are  excluded 
from  competing  for  critical  acquisition 
positions.  The  Air  Force,  on  the  other 
hand,  will  certify  anyone  who  possesses 
the  necessary  education,  training,  and  ex¬ 
perience,  regardless  of  his  or  her  current 
position. 

In  sum,  the  Components  have  imposed 
different  criteria  for  Acquisition  Corps 

membership, 

"In  sunt,  the  Compo¬ 
nents  hove  imposed 
different  criteria  for 
Acquisition  Corps 
membership,  and  in 
some  cases  they 
restrict  membership 
to  those  who  are 
currently  in  acquisi¬ 
tion  billets/' 


and  in  some 
cases  they  re¬ 
strict  member¬ 
ship  to  those 
who  are  cur¬ 
rently  in  acqui¬ 
sition  billets. 
Did  the  law¬ 
makers  intend 
to  ensure  the 


availability  of  a 
ready  pool  containing  the  greatest  possible 
number  of  “best  qualified”  potential  can¬ 
didates,  or  did  they  intend  certification  of 
only  those  civilians  currently  occupying 
acquisition  billets?  We  believe  Air  Force 
policy  is  more  consistent  with  the  intent 
of  D  AWI A  because  it  maximizes  the  num¬ 
ber  of  truly  qualified  people  who  can  be 
considered  to  fill  vacant  acquisition  posi¬ 
tions.  The  fact  that  someone  is  not  cur¬ 
rently  holding  an  acquisition  position  does 


not  diminish  his  or  her  education,  skill, 
knowledge,  or  background.  Moreover, 
military  personnel  are  not  subjected  to  this 
criteria.  In  all  services,  once  an  officer  is 
certified  as  an  acquisition  professional,  he 
or  she  continues  to  possess  this  military 
occupational  specialty  (MOS)  whether  or 
not  the  individual’s  current  assignment  is 


designated  as  an  acquisition  billet.  Thus 
all  personnel,  both  military  and  civilian, 
should  be  eligible  for  acquisition  corps 
membership  based  on  qualifications,  not 
on  a  job  description  or  current  assignment. 

Civilian  Mobility 

DAWIA  encourages  the  Components  to 
promote  mobility  of  civilian  Acquisition 
Corps  members.  It  authorizes  the  Secre¬ 
tary  of  Defense  to  require  civilians  to  sign 
mobility  statements,  and  it  requires  him 
to  identify  categories  of  civilians  who,  as 
a  condition  of  serving  in  the  Acquisition 
Corps,  must  sign  mobility  statements. 
This  authority  has  been  delegated  to  each 
of  the  Defense  Components.10 

Should  civilians  be  required  to  be  geo¬ 
graphically  mobile?  This  is  another  area 
where  DoD  Components  agree  to  dis¬ 
agree.  The  law  is  vague  as  to  what  ex¬ 
actly  is  meant  by  “mobility,”  and  the 
Components  interpret  it  differently.  There 
are  at  least  three  different  definitions: 

•  Functional  mobility  is  a  new  assign¬ 
ment  within  the  same  organization  and 
commuting  area,  but  to  a  position  in 
another  career  field  or  functional  area 
or  specialty. 

•  Organizational  mobility  is  an  assign¬ 
ment  to  a  different  organization  within 
the  same  commuting  area. 

•  Geographic  mobility  is  relocation  out¬ 
side  the  commuting  area. 

The  Army  imposes  all  three  types  of 
mobility  as  a  condition  for  membership 
in  the  Acquisition  Corps.  Although  invol¬ 
untary  mobility  is  its  least  preferred 
method  for  filling  positions,  it  retains  the 
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right  to  enforce  it  under  two  circum¬ 
stances:  to  ensure  that  an  employee  re¬ 
ceives  field  or  headquarters  experience, 
and  to  staff  hard-to-fill  positions  with  spe¬ 
cialized  skills  in  remote  areas.  The  Navy 
requires  no  written  mobility  statement  for 
Acquisition  Corps  membership.  Although 
they  feel  certain  types  of  employees,  such 
as  interns  and  senior  managers,  should 
probably  be  mobile,  they  believe  it  would 
be  counterproductive  and  cost  prohibitive 
to  require  all  civilians  to  be  geographi¬ 
cally  mobile.  The  Air  Force  does  not  spe¬ 
cifically  require  a  mobility  agreement  for 
Acquisition  Corps  membership,  but  dif¬ 
ferent  acquisition  career  fields  (such  as 
program  management)  require  mobility 
agreements.  Within  their  career  fields,  ci¬ 
vilians  indicate  their  geographic  prefer¬ 
ences.  Defense  agencies  do  not  require 
geographic  mobility.  Personnel  are  only 
considered  for  employment  in  the  geo¬ 
graphic  areas  they  choose. 

In  sum,  DoD  Components  vary  in  their 
implementation  of  mobility  requirements. 
The  Army  has  chosen  to  institute  the  most 
comprehensive  approach,  to  include  man¬ 
datory  geographic  relocation;  the  Air 
Force  leaves  the  matter  up  to  each  career 
field;  and  the  Navy  and  DoD  impose  no 
mobility  requirement. 

Mobility  agreements  can  be  a  double- 
edged  sword.  On  one  hand,  they  give 
Components  maximum  flexibility  in  as¬ 
signment  of  personnel,  facilitate  broad¬ 
ening  of  work  experience  at  different  lev¬ 
els,  and  promote  the  ability  of  civilians  to 
compete  against  their  military  counter¬ 
parts.  On  the  other  hand,  relocation  costs 
are  high,  and  the  threat  of  involuntary  re¬ 
location  may  discourage  highly  qualified 
candidates  from  joining  the  Acquisition 
Corps.  In  any  case,  it  is  debatable  whether 


parity  between  civilians  and  the  military 
can  ever  be  achieved  without  some  nor¬ 
malization  of  mobility  requirements. 


Central  Referral  Systems 

DAWI A  requires  the  use  of  centralized 
job  referral  systems.11  The  intent  was  to 
open  positions  to  all  Acquisition  Corps 
members  regardless  of  their  current  loca¬ 
tion.  Again,  Defense  Components  have 
taken  different  approaches.  The  Army’s 
use  of  centralized  job  referral  systems  was 
not  affected  by  DAWIA.  The  Army  fills 
its  critical  acquisition  positions  via  the 
Army  Civilian  Career  Evaluation  System 
(ACCES),  a  centralized  referral  system 
based  on  10  independent  career  programs, 
which  was  in  place  before  passage  of 
DAWIA.  Acquisition  personnel  must  reg¬ 
ister  in  each  ACCESS  career  field  for 
which  they ; 
wish  consider- 

chosen  to  institute 
the  most  comprehen¬ 
sive  approach,  to 
include  mandatory 
^aagraphic  reloca* 
lion;  the  Air  Force  4 
leaves  the  matter  up 
to  each  career  field; 
and  the  Navy  and 
DoD  impose  no  ,4 
mobility  require- 


ation.  When  va¬ 


cancies  arise, 
registrants  are 
automatically  I 
considered  for 
positions  for 
which  they  are 
eligible.  The 
Army  also  uses 
the  Corps  of 
Engineers  refer-  |||eil|/# 
ral  system  and 
Army-wide  va¬ 
cancy  announcements  to  fill  acquisition 
positions. 

In  addition,  the  Army  is  pursuing  some 
ambitious  new  initiatives.  Its  goal  is  to 
have  a  centrally  managed  program,  with 
clearly  established  career  paths  that  will 
include  rotational  assignments  across 
functions  and  organizations.  It  intends  to 
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assess  the  potential  of  acquisition 
workforce  members  in  nine  competencies 
(oral  and  written  communications,  prob¬ 
lem  solving,  leadership,  interpersonal 
skills,  self-direction,  flexibility,  decisive¬ 
ness,  and  technical  competency)  and 
groom  them  for  advancement.  On  an  an¬ 
nual  basis,  it  will  select  the  most  promis¬ 
ing  GS-13s  for  a  “competitive  develop¬ 
ment  group” 
|  "In  sum,  (he  Comp®-  that  will  be  cen- 
i  itenfs  hove  imposed  trally  managed, 
f  different  criteria  for  placed  in  devel- 
Acquisition  Corps  opmental  as- 


membership,  and  in  signments  for  a 

seme  cases  they  three-year  pe- 

restrict  membership  riocj  and  gjven 

to  these  who  are  pri0’rity  piaCe- 

currently  in  ucquisi-  r  a 

Hen  billets."  ment  for  educa- 

tion  and  train- 

v';-v.  ing  before  be¬ 

ing  accessed  into  the  Acquisition  Corps. 

In  the  future,  the  Army  is  considering 
expanding  its  centralized  program  man¬ 
ager  selection  board  process  to  other  key 
leadership  positions.  In  addition,  a  pilot 
program  is  now  under  way  to  centrally 
administer  lateral  assignments  for  Senior 
Service  College  graduates  and  others 
within  the  Program  Executive  Officer 
(PEO)  structure. 

The  Navy  implemented  a  centralized 
job  referral  system  in  1993.  It  consists  of 
a  voice  mail  system  listing  all  civilian 
critical  acquisition  positions  being  filled 
through  merit  promotion.  Using  a  Defense 
Switch  Network  (DSN),  commercial,  or 
1-800  number,  individuals  can  receive 
specific  information  about  each  vacancy 
and  can  obtain  a  copy  of  the  announce¬ 
ment  via  fax. 

The  Air  Force  has  21  career  fields  in¬ 
volved  in  the  acquisition  workforce.  Like 


the  Army,  it  uses  a  system  that  was  in 
place  before  passage  of  DAWIA.  Acqui¬ 
sition  Corps  members  register  for  career 
programs  for  which  they  are  eligible,  and 
they  complete  a  “dream  sheet”  to  indicate 
their  interest  in  geographic  areas.  Vacan¬ 
cies  for  acquisition  positions  at  levels  GS- 
13  through  GS-15  are  sent  to  the  civilian 
personnel  center,  which  maintains  the 
database  for  the  central  referral  system. 
The  system  generates  a  list  of  the  top  30 
candidates:  15  available  for  promotion 
and  15  available  for  lateral  assignment. 
The  selecting  official  makes  his  or  her 
selection  from  that  list  of  candidates,  con¬ 
ducting  interviews  if  desired.  Thus  Air 
Force  Acquisition  Corps  members  are 
automatically  considered  for  positions  as 
they  become  available. 

The  Director  for  Acquisition  Educa¬ 
tion,  Training,  and  Career  Development 
has  established  a  centralized  referral  sys¬ 
tem  (CRS)  to  cover  critical  acquisition 
positions  in  the  Office  of  the  Secretary  of 
Defense,  the  Joint  Staff,  and  defense  agen¬ 
cies,  field  activities,  support  activities,  and 
schools.  It  covers  occupational  series 
groups  across  a  wide  variety  of  areas 
shown  in  the  adjacent  box. 

The  CRS  basically  functions  as  an  an¬ 
nouncement  distribution  system.  Civilian 
personnel  offices  send  vacancy  announce¬ 
ments  for  critical  acquisition  positions  to 
a  central  distribution  point.  From  there, 
copies  of  the  announcements  are  auto¬ 
matically  sent  to  the  homes  of  CRS  reg¬ 
istrants.  Registrants  receive  only  an¬ 
nouncements  that  match  the  grade  levels, 
career  fields,  occupational  series  groups, 
and  geographic  preferences  for  which 
they  have  registered. 

To  sum  up,  the  Army  and  the  Air  Force 
use  established  centralized  referral  sys- 
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OCCUPATIONAL  SERIES 
IN  THE  CENTRALIZED 
REFERRAL  SYSTEM 

Social  science  and  psychology 
Personnel  management 
Physical  sciences 
Biological  sciences 
Accounting  and  budgeting 
Medical 
Veterinary 
Engineering 
Legal 

Information 

Business  and  contracting 
Copyright  and  Patents 
Quality  assurance 
Equipment  and  facilities 
Mathematics 
Library 

Transportation 

Education 

Investigation 

Administrative 

Supply 


terns  that  are  administered  by  functional 
area  and  automatically  generate  lists  of 
potential  candidates.  The  Navy’s  system 
provides  job  announcements  in  response 
to  requests  from  applicants.  DoD’s  sys¬ 
tem  notifies  applicants  when  a  position 
that  matches  their  qualifications  and  pref¬ 
erences  becomes  available.  We  advocate 
a  uniform  system  that  automatically  iden¬ 
tifies  qualified  candidates  in  accordance 
with  their  preferences,  since  this  maxi¬ 
mizes  the  chances  of  finding  the  best  pos¬ 
sible  person  for  the  job. 


Program  Manager  Selection 

DAWIA  specified  minimum  experi¬ 
ence  and  training  requirements  for  person¬ 
nel  in  program  manager,  deputy  program 
manager,  and  PEO  positions.12  The  law  is 
silent,  however,  on  what  means  should  be 
used  to  select  individuals  to  fill  these  se¬ 
nior  acquisition  positions.  Military  depart¬ 
ments  all  use  some  type  of  selection  board 
to  fill  program  manager  positions,  and 
they  all  consider  both  military  and  civil¬ 
ian  candidates  (except  for  positions  des¬ 
ignated  as  military),  but  they  vary  some¬ 
what  in  their  procedures. 

In  the  Army,  program  managers  for 
Acquisition  Category  (ACAT)  I  and  II 
programs  are  selected  by  the  Best  Quali¬ 
fied  Board.  This  board  usually  meets  in 
January  of  each  year  to  review  military 
and  civilian  records  to  identify  the  best 
qualified  applicant  for  each  program  man¬ 
ager  position.  In  addition,  a  program  man¬ 
ager  selection  board  convenes  in  March 
or  April  each  year  to  select  individuals  for 
ACAT  III  program  manager  positions  that 
have  been  designated  for  civilians  only. 
Applications  are  made  to  the  board,  not 
to  the  position.  Preferences  of  the  appli¬ 
cants  for  geographic  or  organizational 
placement  are  not  taken  into  consider¬ 
ation.  If  an  applicant  is  selected  for  a  po¬ 
sition  and  declines  to  accept  it,  he  or  she 
is  no  longer  eligible  to  be  considered  for 
another  program  manager  position. 

Navy  ACAT  I  and  II  program  manag¬ 
ers  and  their  deputies  are  selected  by  a 
centralized  Best  Qualified  panel.  Both 
military  and  civilian  positions  must  be 
advertised,  and  a  panel  is  used  to  rate  and 
rank  the  candidates.  Candidate  slates  are 
then  prepared,  listing  the  civilian  and  mili¬ 
tary  personnel  who  rank  highest.  Call  let¬ 
ters  go  out  to  the  systems  commands  each 
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November  or  December,  requesting  ap¬ 
plications  for  specific  ACAT I  and  II  pro¬ 
gram  manager  positions  that  are  projected 
to  become  vacant  over  the  next  1 8  months. 
These  are  distributed  to  GS-15s,  who  ap¬ 
ply  only  for  those  positions  for  which  they 
wish  to  be  considered. 

The  Air  Force  operates  in  much  the 
same  way  as  the  Army.  Its  selecting  body 
is  called  the  Material  Management  Board. 
Like  the  other  military  departments,  it 
considers  all  civilian  and  military  candi¬ 
dates  for  these  positions. 

In  sum:  All  Military  Departments  use 
a  central  selection  board  process  to  evalu¬ 
ate  civilian  and  military  candidates  for 

major  program 
manager  posi¬ 
tions.  Yet,  they 
operate  under 
different  rules. 
The  main  dif¬ 
ference  tends  to 
be  the  penalty 
associated  with 
declining  an  of¬ 
fer.  If  selected 
by  the  board, 
Army  civilians 
must  accept  a  program  manager  position 
or  they  become  ineligible  for  future  pro¬ 
motion  in  the  Army  Acquisition  Corps. 
Air  Force  civilians  are  removed  from  the 
program  manager  referral  process  for  a 
one-year  period.  Navy  civilians  are  not 
even  considered  for  a  given  program  man¬ 
ager  position  unless  they  apply  for  it. 

We  hesitate  to  make  any  global  asser¬ 
tions  on  the  efficacy  of  the  boards  used 
by  military  departments  to  select  program 
managers  and  deputy  program  managers. 
However,  we  find  that  current  methods  do 
not  result  in  a  uniform  process  nor  in  an 


"In  sum:  All  Military 
Departments  use  a 
f  central  selection 
|  board  process  to 
evaluate  civilian  and 
military  candidates 
for  major  program 
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Yet,  they  operate 
under  different 
rules." 


equitable  distribution  of  civilians  in  ma¬ 
jor  program  manager  positions,  as  we 
shall  see  in  the  next  section. 


Comparison  of  Civilian  and 
Military  Opportunities 


DAWIA  mandates  a  number  of  specific 
actions  relative  to  the  civilian  workforce.13 
It  expressly  limits  conditions  for  prefer¬ 
ring  military  over  civilian  personnel,  and 
it  calls  for  “a  substantial  increase  in  the 
proportion  of  civilians  (as  compared  to 
armed  forces  personnel)  serving  in  criti¬ 
cal  acquisition  positions  in  general,  in 
program  manager  positions,  and  in  divi¬ 
sion  head  positions  over  the  proportion 
of  civilians.”14 

One  metric  for  DAWIA  implementa¬ 
tion  is  the  relative  increase  in  the  number 
and  the  proportion  of  civilians  serving  in 
senior  acquisition  positions.  Another 
benchmark  is  the  education,  training,  and 
assignments  offered  to  the  civilian 
workforce  compared  with  those  available 
prior  to  DAWIA.  The  following  demo¬ 
graphic  trend  data  (Table  1)  suggest  that 
civilian  acquisition  personnel  have  not 
achieved  parity  with  their  military  coun¬ 
terparts. 

Civilian  Versus  Military 
Program  Managers 

As  indicated  in  the  previous  section,  the 
Army,  Navy,  and  Air  Force  all  use  some 
type  of  central  board  to  select  individuals 
to  be  program  managers  of  Major  Systems 
(ACAT  I  and  II  programs),  with  civilian 
and  military  personnel  competing  head  to 
head.  The  selection  board  reviews  an  in¬ 
dividual  applicant’s  file  against  a  prede- 
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Position 

Civilian 

Military 

Acquisition  workforce  (%) 

85 

15 

Senior  acquisition  positions  (%)’ 

67 

33 

PEOs 

8 

16 

ACAT  1  and  II  program  managers 

16 

124 

ACAT  1  and  II  deputy 
program  managers 

91 

25 

Division  heads 

2184 

1577 

’Senior  acquisition  positions  are  made  up  of  ACAT  I  and  II  program  managers,  deputy  program  managers,  PEOs, 
senior  contracting  officials  and  division  heads. 


Table  1* 

Distribution  of  Senior  Acquisition  Positions,  All  Components,  1996 


termined  set  of  criteria  and  recommends 
selection  of  the  most  qualified  individual 
for  the  position. 

Despite  these  apparently  impartial  pro¬ 
cedures,  DAWIA  has  not  had  a  dramatic 
impact  on  the  number  of  civilians  serv¬ 
ing  in  ACAT  I  or  ACAT  II  program  man¬ 
ager  positions.  There  is  a  disproportion¬ 
ate  allocation  between  military  and  civil¬ 
ian  acquisition  professionals  in  these  jobs. 
Table  2  shows  that  in  1996,  military  per¬ 
sonnel  constituted  15  percent  of  the  ac¬ 
quisition  workforce,  yet  they  held  89  per¬ 
cent  (124  out  of  a  total  of  140)  of  the 
ACAT  I  and  ACAT  II  program  manager 
positions.15 

On  the  other  hand,  deputy  program 
manager  positions  are  predominantly  ci¬ 
vilian.  The  same  85  percent  of  the  acqui¬ 
sition  workforce  that  held  only  1 1  percent 
(16  out  of  140)  of  the  program  manager 
jobs  held  a  more  representative,  but  still 


under-represented,  78  percent  (91  out  of 
116)  of  the  deputy  program  manager  po¬ 
sitions.  Some  sources  suggest  that  the  re¬ 
sulting  mix  is  the  optimal  blend  of  mili¬ 
tary  leadership  and  civilian  continuity. 
Nevertheless,  the  fact  remains  that  the 
distribution  of  ACAT  I  and  ACAT  II  pro¬ 
gram  manager  and  deputy  program  man¬ 
ager  positions  is  inconsistent  with  the  de¬ 
mographics  of  the  population. 

Trends  over  the  past  few  years  are  not 
encouraging.  Table  2  shows  that  civilian 
representation  is  declining  in  both  criti¬ 
cal  acquisition  positions  and  senior  acqui¬ 
sition  positions.16 

To  summarize,  DAWIA  called  for  the 
gradual  increase  in  the  number  of  civil¬ 
ian  program  managers  as  their  training 
and  experience  equipped  them  to  effec¬ 
tively  compete  to  be  “best  qualified.”  The 
progress  to  date  has  been  disappointing. 
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1994 

1995 

1996 

Percent  critical  acquisition  positions  (civilian) 

85 

80 

79 

Percent  senior  acquisition  positions  (civilian) 

71 

71 

67 

Table  2.  Civilian  Acquisition  Positions,  All  Components 


Civilian  versus  Military 
Education  and  Training 

Civilian  participation  in  Senior  Service 
School  provides  another  benchmark  of 
DAWIA’ s  impact.  The  pinnacle  of  Profes¬ 
sional  Military  Education  (PME)  is  Se¬ 
nior  Service  School.  As  the  last  formal 
educational  opportunity  for  most  senior 
level  officers  (and  civilians),  it  is  a  quali¬ 
fying  credential  on  the  path  to  senior  as¬ 
signments.  Thus  we  should  expect  to  see 
an  increase  in  civilian  attendance  at  Se¬ 
nior  Service  Schools  and  all  levels  of  PME 
since  DAWIA  was  passed  in  1991.  There 
are  six  Senior  Service  Schools  (Table  3). 


The  population  of  civilian  and  military  at¬ 
tendees  at  each  of  the  Senior  Service 
Schools  from  1990  through  1996  (the 
DAWIA  years)  is  described  in  Appendix 
A  and  portrayed  in  Figure  1. 

As  the  data  indicate,  civilian  enrollment 
in  the  Senior  Service  Schools  remained 
fairly  constant  (ranging  from  110  to  123) 
from  1991  through  1994.  The  years  1995 
and  1996  saw  civilian  participation  in  the 
Senior  Acquisition  Course  (SAC)  raise  the 
combined  figures  for  all  schools  to  140 
and  143,  respectively.  The  Senior  Acqui¬ 
sition  Course  traces  its  origin  to  DAWIA 
and  Defense  Acquisition  University.  It  has 


SCHOOL 

SERVICE 

Army  War  College 

Army 

Naval  War  College 

Navy 

Air  War  College 

Air  Force 

Marine  Corps  War  College 

Marine  Corps 

National  War  College 

Joint 

Industrial  College  of  the 

Armed  Forces1 

Joint 

'Includes  the  Senior  Acquisition  Course  established  under  DAWIA. 

Table  3*  Senior  Service  Schools 
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Figure  1*  Military  and  Civilian  Attendees  in  Senior  Service  School 


helped,  but  not  dramatically.  A  future 
study  to  evaluate  the  relative  percentage 
of  civilian  and  military  Acquisition  Corps 
members  would  be  a  useful  undertaking. 

The  conclusion  is  that  civilians  con¬ 
tinue  to  be  under  represented  in  certain 
categories  of  senior  acquisition  positions, 
such  as  ACAT  I  and  II  program  manag¬ 
ers.  Further,  they  continue  to  be  under 
represented  across  the  board  in  all  senior 
acquisition  positions.  Outside  of  the  slight 
increases  associated  with  the  Senior  Ac¬ 
quisition  Course,  DAWIA  has  had  mar¬ 
ginal  effect  on  civilian  participation  in 
Senior  Service  Schools. 

COHCLUSIONS 


What  has  DAWIA  accomplished?  It  has 
succeeded  in  prompting  the  DoD  Com¬ 
ponents  to  take  the  steps  necessary  to  pro¬ 
fessionalize  the  defense  acquisition 
workforce.  In  response  to  DAWIA,  the 
military  departments  have  raised  stan¬ 
dards,  increased  training,  and  enhanced 


development  of  their  acquisition  person¬ 
nel.  As  a  result,  we  believe,  both  military 
and  civilian  acquisition  personnel  have 
benefited  over  the  past  five  years.  DAWIA 
implementation  has  brought  about  many 
sorely  needed  changes  and  has  allowed 
DoD  Components  to  move  forward  to 
meet  the  daily  acquisition  challenges  with 
a  more  highly  trained  and  better  equipped 
workforce. 

However,  change  has  been  rather  slow. 
DAWIA  was  enacted  in  1991,  yet  the 
Components  did  not  begin  to  accomplish 
many  of  its  provisions  until  much  later. 
Some  attribute  the  delay  to  “service- 
unique  culture,”  while  others  admit  that 
implementation  may  not  be  as  far  along 
as  they  would  like.  In  every  case,  how¬ 
ever,  those  we  interviewed  felt  that  they 
are  better  off  now  than  they  were  before 
DAWIA. 

Each  Component  we  interviewed  was 
genuinely  concerned  about  its  acquisition 
workforce.  They  shared  a  strong  commit¬ 
ment  to  furthering  professional  workforce 
development.  We  were  especially  im- 
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pressed  by  the  Navy’s  commitment  to  a 
full-time  SES-level  DACM,  the  Air  Force 
central  referral  system  and  staffing  pro¬ 
cess,  and  the  recent  Army  initiatives  to 
enhance  its  civilian  acquisition  workforce. 

No  doubt  DAWIA  has  made  a  differ¬ 
ence.  However,  more  remains  to  be  done. 
Our  analysis  revealed  at  least  two  areas 
in  need  of  improvement:  There  is  a  lack 
of  uniformity  across  DoD  Components; 
there  are  disparate  professional  develop¬ 
ment  opportunities  for  civilian  and  mili¬ 
tary  personnel.  We  will  now  consider  the 
reasons  for  these  conditions  and  discuss 
why  they  matter. 


Lack  of  Uniformity 

Even  though  there  is  one  law,  imple¬ 
mentation  throughout  the  DoD  Compo¬ 
nents  is  uneven.  There  is  general  compli¬ 
ance  with  DAWIA  and  DoD  regulations, 
and  to  some  extent  there  is  uniformity 
across  the  Components.  However,  there 
are  many  instances  where  the  same  statu¬ 
tory  provision  was  carried  out  differently. 

Since  responsi¬ 
bility  for  imple¬ 
mentation  was 
delegated  to  the 
various  Com¬ 
ponents,  they 
established  dif¬ 
ferent  require¬ 
ments  for  Ac¬ 
quisition  Corps 
membership, 
imposed  differ¬ 
ent  mobility 
rules,  and  used 
different  mechanisms  to  fill  acquisition 
positions. 

It  is  not  very  clear  why  the  Components 
diverged  in  their  policies  and  practices. 


"Our  analysis  re¬ 
vealed  at  least  two 
areas  in  need  of 
improvement:  There 
is  a  lack  of  unifor¬ 
mity  across  DoD 
Components;  there 
are  disparate  pro¬ 
fessional  develop¬ 
ment  opportunities 
for  civilian  and 
military  personnel*" 


Tradition,  culture,  and  internal  politics 
probably  drove  many  decisions.  Does  it 
really  matter  whether  the  Components 
differ  from  one  another?  Despite  their  dif¬ 
ferences,  they  are  functioning  relatively 
well  and  making  incremental  progress. 
Yet  the  law  requires  uniformity  to  the 
maximum  extent  practicable.  What’s 
more,  similar  policies  and  practices  make 
sense  in  today’s  environment,  which  in¬ 
creasingly  stresses  the  importance  of  joint 
operations. 

We  believe  that  the  Office  of  the  Sec¬ 
retary  of  Defense  and  the  Military  Depart¬ 
ments  could  do  more  to  match  the  right 
person  to  the  job  if  they  used  an  integrated 
centralized  referral  system.  The  original 
intent  of  the  framers  of  DAWIA  was  to 
promote  centralized  referral  for  civilians, 
not  only  within  military  departments  but 
across  them.  Draft  recommendations  of 
the  House  Armed  Services  Committee’s 
Subcommittee  on  Investigations,  dated  8 
March  1990,  called  for  the  Under  Secre¬ 
tary  of  Defense  for  Acquisition  to  “evalu¬ 
ate  the  feasibility  and  desirability  of  es¬ 
tablishing  a  DoD-wide  referral  system  that 
would  enhance  the  ability  of  civilian  ac¬ 
quisition  personnel  to  acquire  ‘joint  ex¬ 
perience’  as  do  military  personnel.”  While 
this  provision  never  made  it  into  the  final 
version  of  bill,  we  think  the  idea  has  merit. 
This  is  particularly  true  in  view  of  the 
current  emphasis  on  “jointness”  and  the 
reduced  opportunities  for  advancement 
associated  with  the  drawdown  in  acquisi¬ 
tion  programs. 

Civilian  and  Military  Disparity 

Despite  small  gains  in  the  number  of 
civilians  that  hold  senior  acquisition  po¬ 
sitions,  there  is  still  a  significant  dispar¬ 
ity.  The  distribution  of  the  acquisition 
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workforce  and  the  relative  makeup  of 
military  and  civilian  positions  suggest  a 
systemic  bias  in  the  process,  which  serves 
to  provide  better  access  to  program  man¬ 
ager  positions  for  military  members  than 
for  civilians. 

Why  is  it,  after  five  years  of  DAWIA- 
sponsored  training  and  education,  that 
selecting  officials  (and  these  include  ci¬ 
vilians)  find  civilians  best  qualified  to  be 
deputies  and  their  military  counterparts 
best  qualified  to  be  program  managers? 
Is  it  bias?  Is  it  education?  Is  it  training?  Is 
it  culture?  Is  it  Office  of  Personnel  Man¬ 
agement  (OPM)  constraints? 

We  think,  in  some  respects,  all  of  these 
elements  contribute.  Some  officials  be¬ 
lieve  that,  on  the  strength  of  their  train¬ 
ing,  military  members  make  better  lead¬ 
ers.  Some  believe  that  operational  expe¬ 
rience  is  a  vital  element  in  the  program 
manager’s  makeup.  Some  argue  that  be¬ 
cause  civilians  lack  mobility,  civilian  pro¬ 
gram  managers  would  limit  promotion 
opportunities  for  junior  members  by  en¬ 
cumbering  positions  indefinitely  (al¬ 
though  this  is  prohibited  by  law).  Others 
believe  that  the  different  personnel  sys¬ 
tems  make  military  more  attractive  than 
civilian  managers.  (They  are  easier  to  hire 
and  fire!) 

While  it  may  be  true  that  all  of  these 
issues  have  some  bearing  on  selection,  we 
are  firmly  convinced  that  selection  boards 
continue  to  pick  military  members  over 
civilian  members  for  the  very  simple  rea¬ 
son  that  they  are  better  qualified  for  what 
are  essentially  leadership  positions.  Why 
do  selection  boards  find  them  more  quali¬ 
fied?  The  answer  lies  in  the  nature  and 
breadth  of  experience  that  typifies  the 
military  versus  civilian  career.  The  cul¬ 
tural  realities  of  the  services  and  the  per¬ 


-u:; 


sonnel  systems  they  employ  are  funda¬ 
mental  to  this  reality. 

The  military  career  is  predicated  upon 
a  mix  of  assignments,  training,  and  edu¬ 
cation.  This  mix  features  mobility,  pro¬ 
gression,  challenge  and  leadership  devel¬ 
opment.  At  its 

very  core,  it  is  a  « ,.we  ore  firmly 
competitive  up  eOBV,Bced  fha, 
or  out”  system,  .election  boards 
The  fundamen-  continue  to  pick 
tal  competen-  military  members 
cies  are  broad  over  civilian  mem- 
perspective  and  bers  lor  the  very 
leadership.  The  reason  that 

military  path  to  ,he*  •r*  h*"*' 
success  follows  ««»«»«*«*  *or"hat 
a  senes  of  relo-  leoder9h{p  posi. 
cations  to  jobs  §|olfS/* 
of  increasing 
difficulty,  com¬ 
plexity,  and  visibility.  It  requires  exten¬ 
sive  Professional  Military  Education 
(PME),  operational  experience,  and  ad¬ 
vanced  academic  degrees — usually  tech¬ 
nical.  The  competitive  nature  of  the  pro¬ 
motion  system  serves  to  retain  only  the 
most  promising  members  in  an  ever- 
shrinking  advancement  pool. 

The  traditional  civilian  career  path  has 
been  functionally  based.  Unlike  the  mili¬ 
tary  path,  which  traverses  the  mountain 
to  gain  the  summit,  the  civilian  path  is 
more  of  a  spiral  staircase.  It  focuses  on 
depth  and  expertise  in  narrowly  defined 
functional  stovepipes.  Promotion  comes 
within  a  functional  world  where  ever-in- 
creasing  technical  excellence  (in  accor¬ 
dance  with  OPM  standards)  is  the  basis 
for  advancement.  Lateral  mobility  across 
career  fields  is  difficult  and  costly.  Geo¬ 
graphic  mobility,  though  encouraged,  is 
not  necessarily  required.  Advanced  tech- 
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nical  and  management  degrees  are  re¬ 
quired.  PME  is  not.  The  fundamental 
value  is  technical  competence  and  stabil¬ 
ity.  Mobility  and  leadership  were  not  criti¬ 
cal  attributes  of  the  career  civilian.  This 
reality  is  grounded  in  OPM  requirements 
and  public  law. 

Qualifying  experience,  in  a  given  func¬ 
tional  area,  is  probably  the  most  limiting 
factor  in  civilian  career  development. 
While  OPM  restrictions  arguably  protect 
and  promote  the  best  qualified  for  a  given 
position,  job  series  requirements  and 
qualification  standards  combine  to  effec¬ 
tively  limit  civilians  to  a  single  functional 
career  path,  often  in  a  single  location. 
Where  the  military  system  develops  mo¬ 
bile  generalist  leaders,  the  civilian  system 
develops  stable  functional  experts. 

Program  management  is  all  about  lead¬ 
ership  and  broad  perspective.  In  order  to 
compete  effectively  for  the  top  jobs,  ci¬ 
vilians  need  to  have  at  least  the  same  lev¬ 


els  of  education,  training,  and  experience 
as  those  against  whom  they  must  compete. 

On  the  basis  of  our  study,  DAWIAhas 
yet  to  effect  the  “substantial”  civilian  ad¬ 
vancement  it  was  intended  to  achieve. 
Inequities  in  education,  training,  and  ex¬ 
perience  persist,  but  they  can  be  overcome 
as  long  as  managers  and  employees  alike 
are  willing  to  commit  to  a  career  devel¬ 
opment  program  that  promotes  leadership 
(PME),  broad  perspective  (functional 
mobility),  and  diverse  work  experience 
(organizational  mobility). 

Why  is  this  important?  First  of  all,  the 
law  requires  it.  Second,  good  business 
practice  mandates  effective  and  efficient 
use  of  all  our  human  resources,  enabling 
the  best  and  the  brightest,  whether  civil¬ 
ian  or  military,  to  rise  to  the  most  senior 
acquisition  positions.  Finally,  and  perhaps 
most  important,  it  is  the  right  thing  to  do. 
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_ Appendix  A _ 

Senior  Service  School  Attendance:  1991  Through  1996 
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Endnotes 


1.  Public  Law  101-510,  “National  De¬ 
fense  Authorization  Act  for  Fiscal 
Year  1991,”  Title  XII,  Defense  Ac¬ 
quisition  Workforce  Improvement  Act. 
November  5,  1990.  (Sections  1701- 
1764  of  Title  10,  United  States  Code). 

2.  For  purposes  of  this  study,  DoD  Com¬ 
ponents  are  defined  as  the  Military 
Departments  (Army,  Navy,  Air  Force) 
and  Defense  Agencies. 

3.  “Section  1701(b)  UNIFORM 
IMPLEMENTATION.— The  Secre¬ 
tary  (of  Defense)  shall  ensure  that,  to 
the  maximum  extent  practicable ,  ac¬ 
quisition  workforce  policies  and  pro¬ 
cedures  established  in  accordance 
with  this  chapter  are  uniform  in  their 
implementation  throughout  the  De¬ 
partment  of  Defense.” 

4.  The  Director  for  Acquisition  Educa¬ 
tion,  Training  and  Career  Develop¬ 
ment  was  established  within  the  Of¬ 
fice  of  the  Undersecretary  of  Defense 
for  Acquisition  and  Technology  to 
oversee  DAWI A  implementation  and 
to  manage  the  acquisition  workforce 
within  defense  agencies.  The  Direc¬ 
tor  for  Acquisition  Career  Manage¬ 
ment  was  established  within  each 
Military  Department  under  the  re¬ 
spective  Service  Acquisition  Execu¬ 
tive  to  manage  the  acquisition 
workforce  within  each  Military  De¬ 
partment 


5 .  For  the  sake  of  brevity,  this  is  an  over¬ 
simplification  of  the  statutory  require¬ 
ments  for  all  acquisition  career  fields 

6.  Public  Law  101-510,  Title  10,U.S.C., 
Section  1732. 

7.  “Section  1722(d)  Best  qualified. — 
The  Secretary  of  Defense  shall  ensure 
that  the  policies  established  under  this 
chapter  are  designed  to  provide  for  the 
selection  of  the  best  qualified  indi¬ 
vidual  for  a  position,  consistent  with 
other  applicable  law.” 

8.  “Acquisition  Professional  Commu¬ 
nity”  is  the  Navy  term  for  Acquisi¬ 
tion  Corps.  The  Navy  decided  against 
the  term  “Acquisition  Corps”  to  avoid 
confusion  with  its  other  “corps.” 

9.  Welcome  to  the  Acquisition  Work¬ 
force ,  An  Introductory  Guide  to  the 
Department  of  the  Navy  Acquisition 
Workforce  Program,  p.  10. 

10.  “Section  1732(e)  MOBILITY 
STATEMENTS.— (1)  The  Secretary 
of  Defense  is  authorized  to  require  ci¬ 
vilians  in  an  Acquisition  Corps  to  sign 
mobility  statements.  (2)  The  Secretary 
of  Defense  shall  identify  which  cat¬ 
egories  of  civilians  in  an  Acquisition 
Corps,  as  a  condition  of  serving  in  the 
corps,  shall  be  required  to  sign  mo¬ 
bility  statements.” 
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11.  “Section  1734  Part  (f) — ' The  Secre¬ 
tary  of  Defense  shall  prescribe  regu¬ 
lations  providing  for  the  use  of  cen¬ 
tralized  lists  to  ensure  that  persons  are 
selected  for  critical  positions  without 
regard  to  geographic  location  of  ap¬ 
plicants  for  such  positions.” 

12.  Public  Law  101-510,  Title  10,  U.S.C., 
Section  1735(b)  and  (c). 

13.  “Section  1722(c)  OPPORTUNITIES 
FOR  CIVILIANS  TO  QUALITY. 
The  Secretary  of  Defense  shall  ensure 
that  civilian  personnel  are  provided 
the  opportunity  to  acquire  the  educa¬ 
tion,  training  and  experience  neces¬ 
sary  to  qualify  for  senior  acquisition 
positions.” 

“Section  1722(b).  LIMITATION  ON 
PREFERENCE  FOR  MILITARY 
PERSONNEL— (1)  The  Secretary  of 
Defense  shall  ensure  that  no  require¬ 
ment  or  preference  for  a  member  of 
the  armed  forces  is  used  in  the  con¬ 
sideration  of  persons  for  acquisition 
positions,  except  (when  required  by 
law,  when  essential  for  performance 
of  the  duties  of  the  position,  or  for 
another  compelling  reason).” 


14.  “Section  1722(e)  MANAGEMENT 
OF  WORKFORCE.  The  Secretary  of 
Defense  shall  ensure  that  the  acquisi¬ 
tion  workforce  is  managed  such 
that... there  is  a  substantial  increase  in 
the  proportion  of  civilians  (as  com¬ 
pared  to  armed  forces  personnel) 
serving  in  critical  acquisition  posi¬ 
tions  in  general,  in  program  manager 
positions,  and  in  division  head  posi¬ 
tions  over  the  proportion  of  civilians 
(as  compared  to  armed  forces  person¬ 
nel)  in  such  positions  on  October  1, 
1990.” 

15.  Director,  Acquisition  Education, 
Training  and  Career  Development 
memorandum,  subject:  Secretary  of 
Defense’s  FY  1996  (1997)  Annual 
Report  to  the  Congress,  5  February 
1997. 

17.  Ibid. 
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QUALITY  FUNCTION  DEPLOYMENT 
AS  A  TOOL  FOR  IMPLEMENTING 
COST  AS  AN  INDEPENDENT  VARIABLE 

David  R.  Wollover 


The  essence  of  cost  as  an  independent  variable  (CAIV)  is  using  reliable  tools 
to  balance  cost  with  mission  needs  for  new  program  development.  This  article 
addresses  concerns  about  implementing  CAIV  for  Department  of  Defense  (DoD) 
acquisition  programs  that  vary  by  scope,  budget,  and  dimension.  Perhaps  no 
single  CAIV  implementation  tool  is  robust  enough  to  apply  to  all  cases.  However, 
we  are  interested  in  tools  to  implement  CAIV  for  a  maximum  number  of  programs 
to  collect  lessons  learned  and  related  beneficial  aspects  of  the  CAIV  learning 
curve. 

This  article  describes  and  illustrates  Quality  Function  Deployment  (QFD)  as  a 
tool  with  good  potential  to  help  implement  CAIV  for  a  variety  of  DoD  acquisition 
programs.  An  example  of  a  generic  acquisition  system  (a  weapon  system  in 
this  writing)  not  attributed  to  any  specific  program  is  used.  The  example  is 
actually  elementary  compared  to  some  advanced  QFD  applications.  However, 
it  is  still  manifold  enough  to  illustrate  a  fairly  detailed  QFD  application.  While 
this  paper  focuses  on  a  weapon  system,  the  same  process  may  be  applied  to 
automated  information  system  (AIS)  programs,  with  appropriate  modifications. 

QFD  consists  of  six  general  steps:  (a)  identifying  and  analyzing  customer  needs 
and  requirements,  (b)  identifying  technical  performance  measures  (TPMs),  (c) 
benchmarking  TPMs,  (d)  assigning  priority  to  customer  requirements,  (e) 
establishing  TPMs  to  identify  specific  design  characteristics,  and  (f)  evolving 
technical  performance  measures  into  the  follow-up  design  phase’s  requirements. 
This  elementary  example  will  illustrate  QFD,  providing  a  framework  to  transform 
vague  customer  requirement  statements  into  TPMs  that  are  deployed  throughout 
system  design  and  development. 


DoD  has  adopted  a  strategy  to  use 
aggressive,  realistic  cost  objectives 
to  acquire  systems,  and  managing 
risks  to  obtain  objectives.  These  objectives 


must  balance  mission  needs  with  projected 
out-year  resources,  accounting  for  exist¬ 
ing  technology  as  well  as  high-confidence 
maturation  of  new  technologies. 
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This  concept  is  called  cost  as  an  inde¬ 
pendent  variable  (CAIV),  meaning  that 
once  a  system’s  performance  and  objec¬ 
tive  costs  are  decided  on  the  basis  of  cost- 
performance  tradeoffs,  the  acquisition  pro¬ 
cess  establishes  cost  as  a  constraint,  rather 
than  as  a  dependent  variable,  while  still 
getting  the  needed  military  capability 
(ODUSD  [AR]),  1996).  Tradeoffs  are 
made  among  cost,  schedule,  and  perfor¬ 
mance  based  on  CAIV  analysis  (Office  of 
the  Secretary  of  Defense,  1996). 

In  a  Dec.  4, 1995,  memorandum  on  life 
cycle  cost  reduction.  Dr.  Paul  Kaminski 
requested:  (a)  cost  performance  trades;  (b) 
aggressive  program  management,  making 
cost  a  major  independent  driver,  while 
preserving  warfighter  requirements;  (c) 
expanding  use  of  existing  techniques  to 
meet  program  goals;  and  (d)  reducing  un¬ 
necessary  program  and  product  complex¬ 
ity  (Kaminski,  1995). 

Guidance  attached  to  Kaminski’s 
memorandum  calls  for  CAIV  to  include: 
(a)  adopting  aggressive  realistic  cost  goals 
for  operations  and  support,  as  well  as  pro¬ 
duction,  with  well-defined  steps  leading 
to  objectives;  (b)  using  existing  practices 
proven  to  have  managed  meeting  cus¬ 
tomer  requirements;  and  (c)  formalizing 


the  cost-performance  tradeoff  process 
through  performance  specifications  used 
to  state  requirements  in  a  manner  that 
clearly  directs  the  CAIV  process  to  evalu¬ 
ate  all  pertinent  design  parameters  that 
serve  as  key  metrics  and  observables, 
while  assuring  preserving  needed  military 
capability  (Longuemare,  1995). 

CAIV  Metric  and  Observables 

The  CAIV  Working  Group  Paper  Sum¬ 
mary,  an  attachment  to  Kaminski  (1995), 
describes  the  instrumental  role  of  key 
metrics  and  observables.  This  attachment 
describes  the  importance  of  setting  early 
cost  objectives.  The  ability  to  set  cost  ob¬ 
jectives  depends  on  results  of  early  cost- 
performance  tradeoff  analyses.  Metrics 
and  observables  are  needed  to  assess 
CAIV  implementation  progress. 

Metrics  and  observables  identify  ob¬ 
servable  steps  for  meeting  aggressive  pro¬ 
duction  and  operations  and  support  cost 
objectives,  and  then  managing  for  their 
achievement.  Conrow  (1995,  p.  209)  in¬ 
dicates  that  a  significant  influence  on  cre¬ 
ating  DoD  program  development  cost,  and 
technical  and  schedule  risk  is  incorrectly 
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referee  for  the  Journal  of  Cost  Analysis,  and  presented  various  cost  analysis  papers  for  SCEA, 
ISPA,  and  REVIC  Users  Group. The  Certified  Cost  Estimator/Analyst  (CCE/A)  professional  des¬ 
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specified  technical  possibilities.  Both  gov¬ 
ernment  and  contractors  “routinely  under¬ 
estimate  the  risk  present  in  military  pro¬ 
grams.”  Risk  reduction  steps  for  technol¬ 
ogy  development  and  application,  manu¬ 
facturing,  and  operations  can  be  guided 
by  unbiased  metrics  and  observables  tai¬ 
lored  to  specific  programs. 


Significance  of  Technical 
Performance  Measures 


Examining  the  DoD  description  of  “key 
metrics  and  observables”  (Kaminski, 
1995)  reveals  they  are  similar  to  what  sys¬ 
tem  engineers  call  technical  performance 
measures  (TPMs)  (Verma,  Chilakapati,  & 
Blanchard,  1996,  p.  39).  Titles  are  less 
important  than  insights  to  correlations 
among  key  performance  parameters 
(KPPs),  critical  technical  parameters 
(CTPs),  or  other  TPM  candidates  de¬ 
scribed  in  the  literature,  for  example,  by 
Higgins  (1997,  pp.  45-46)  and  Jones 
(1996,  p.  151). 

Risks  to  meeting  performance  require¬ 
ments  with  aggressive  cost  goals  must  be 
managed  through  iterated  cost,  perfor¬ 
mance,  and  schedule  tradeoffs,  identify¬ 
ing  performance,  manufacturing,  or  opera¬ 
tions  uncertainties,  and  demonstrating  so¬ 
lutions  prior  to  final  design.  We  seek  to 
efficiently  manage  weapon  system  com¬ 
plexity,  defined  here  as  an  evolving  large 
number  of  interfaces,  parts,  and  final  test¬ 
ing  requirements  among  maturing  system 
configuration  elements  (Gindele,  1996,  p. 
66).  In  this  context  we  seek  proven  means 
to  systematically  organize  all  independent 
variables  and  their  interrelationships. 

Commitments  to  technology,  system 
configuration,  performance,  and  life  cycle 


cost  are  strong  even  in  early  system  de¬ 
sign.  Many  system  characteristics  inter¬ 
act;  consequences  of  these  static  and  dy¬ 
namic  interactions  are  rarely  well  evalu¬ 
ated  or  understood.  There  are  ample  op¬ 
portunities  to  reduce  costs  while  life  cycle 
decisions  continue  to  be  made.  Progress 
may  be  created  by  techniques  that  enable 
earlier  use  of  integrated  design  informa¬ 
tion  (Fabrycky,  1994,  pp.  134-136). 

The  best  time  to  reduce  life  cycle  costs 


is  early  in  the  acquisition  process,  when 
cost-performance  tradeoff  analyses  are 
conducted  to  decide  an  acquisition  ap¬ 
proach.  However,  because  factors  both  in¬ 
ternal  and  external  to  the  program  change, 
tradeoffs  must  occur  throughout  the  ac¬ 
quisition  process,  and  key  TPMs  may  also 
significantly  change  throughout  program 
evolution. 

Still,  it  is  critical  to  CAIV  that  the  pro¬ 
cess  of  setting  TPMs  reflecting  cost  and 
performance  objectives  begin  as  early  as 
possible.  The  ability  to  achieve  cost  ob¬ 
jectives  greatly  depends  on  early  executed 
cost-performance  tradeoffs,  including  us¬ 
ing  TPMs  to  measure  and  thus  better  man¬ 
age  risk  mitiga-  gf 
tion.  Specifi¬ 
cally,  for  ex¬ 
ample,  as  in  the 
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"Titles  are  less 
important  than 
insights  to  correla- 
case  of  the  F-22  tions  among  key 
program,  TPM  performance  param* 
changes  may  be  1  eters  (KPPs),  critical 
observed  in  di-  f  technical  parameters 
rect  response  to  (CTPs),  or  ethep‘  TPM 
risk  reduction 
efforts  (Justice, 

1996,  p.  70). 

Consequently,  applying  CAIV  TPMs  to 
DoD  programs  entails:  (a)  setting  cost  and 
performance  objectives  as  early  as  pos¬ 
sible;  (b)  quantifying  these  objectives  as 
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TPM  threshold  values,  tailored  to  specific 
assets  and  activities;  (c)  setting  pathways 
supporting  observable  transitions  between 
objective-oriented  actions;  (d)  adhering  to 
a  cost-performance  tradeoff  process  that 
has  structured  all  relationships  among 
TPMs;  and  (e)  empowering  program  man¬ 
agers  to  flexibly  respond  to  changes  in  the 
set(s)  of  TPMs  and  their  values. 


Introduction  to 
Quality  Function  Deployment 


Quality  function  deployment  (QFD)  is 
a  well-established  procedure  that  essen¬ 
tially  uses  a  series  of  interdependent  ma¬ 
trices.  The  matrices  are  used  to  organize 
and  translate  customer  requirements,  in  an 
integrated  fashion,  to  the  successive  steps 
that  ultimately  meet  these  requirements. 
QFD  has  been  used  in  a  wide  variety  of 
”  ^  industries  to  use 


"Quality  function 
deployment  (QFD)  is 
a  well-established 
procedure  that 
essentially  uses  a 


TPMs  to  trans¬ 
late  and  literally 
map  customer 
needs  into  ob¬ 
jective  product 


series  of  interdepen-  outcomes.  QFD 
dent  matrices/7  is  a  historically 

proven  means 


to  guide  process 
development  using  TPMs  to  systemati¬ 
cally  organize  all  independent  variables 
(cost,  etc.),  and  their  interrelationships. 
QFD  is  cited  as  the  most  widespread 
implementation  of  total  quality  manage¬ 
ment  (TQM)  (Sage,  1992,  p.  222),  and  as 
a  key  facilitating  tool  in  concurrent  engi¬ 
neering  environments  (Menon  et  al.,  1994, 
p.  91). 


QFD  is  a  process  tool  that  helps 
strengthen  management  of  key  elements 
of  the  system  engineering  process  for  DoD 
advanced  technology  development  pro¬ 
grams.  QFD  is  structured  to  accommodate 
vaguely  stated  customer  specifications, 
and  through  a  series  of  interdependent 
matrices,  allocate  and  map  requirements 
into  specific  design  strategies,  develop¬ 
ment  processes,  product  characteristics, 
and  program  operations  controls.  For  each 
intended  result  of  the  design  and  produc¬ 
tion  process,  engineers  identify  TPMs,  and 
then  specify  corresponding  threshold  val¬ 
ues  to  be  met  in  order  to  achieve  the  re¬ 
quired  features  of  the  overall  system. 
These  assignments  set  the  minimum  lev¬ 
els  of  achievement  required  to  satisfy  cus¬ 
tomer  requirements. 


Origins  of 

Quality  Function  Deployment 


QFD  was  developed  in  the  late  1960s 
by  Shigeru  Mizano  of  the  Tokyo  Institute 
of  Technology  (Menon  et  al.  1994,  p.  94). 
Mitsubishi  Heavy  Industries  also  began  to 
use  it  then  on  supertanker  projects  at  Kobe 
Shipyard.  Mitsubishi  tried  to  build  300- 
yard-long  supertankers  having  sophisti¬ 
cated  propulsion,  maneuvering,  and  bal¬ 
ance  control,  challenging  design  and 
manufacturing  logistical  requirements, 
and  having  essentially  no  production  line 
(Guinta  and  Praizler,  1993,  p.  1). 

Toyota  adopted  the  Kobe  shipyard  QFD 
methodology  in  the  mid-1970s.  Toyota  set 
performance  benchmarks  combined  with 
customer  focus  groups.  They  experienced 
40  percent  reductions  in  new  model  de- 
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velopment  costs,  and  a  50  percent  reduc¬ 
tion  in  development  time  (Menon  et  al. 
1994,  p.  94;  Prasad,  1996,  p.  82). 
Panasonic  Consumer  Electronics  pushed 
QFD  to  greater  limits  in  the  mid-1970s. 
They  used  it  to  predict  what  consumers 
would  want  in  the  future,  ergo  their  slo¬ 
gan  “Just  slightly  ahead  of  our  time” 
(Guinta  and  Praizler,  1993,  p.  4). 

A  1986  survey  of  Japanese  Union  of 
Scientists  and  Engineers  reported  that  54% 
used  QFD,  most  of  them  in  high  technol¬ 
ogy  and  transportation  industries.  The 
Japanese  exploited  QFD  to  structure  pro¬ 
duction  and  supporting  operations  to  be¬ 
come  less  sensitive  to  variations  caused 
by  operators,  equipment,  and  materials 
(Guinta  and  Praizler,  1993,  p.  7).  A  most 
interesting  historical  note  is  that  QFD  was 
applied  principally  in  companies  and  prod¬ 
ucts  primary  to  Japan’s  export  business, 
particularly  to  the  United  States  (Sanchez 
et  al.,  1993,  p.  239). 


The  United  States  Experience 
With  QFD 


Ford  Automotive  applied  QFD  in  the 
early  1980s,  using  it  to  reorganize  sequen¬ 
tial  functions  to  concurrent  interaction  of 
design,  engineering,  and  manufacturing. 
Ford  used  more  than  50  applications  of 
QFD  to  (a)  establish  quality  goals;  (b) 
identify  customers  and  others  affected;  (c) 
discover  customer  needs,  such  as  in¬ 
creased  reliability;  (d)  develop  longer 
maintenance-free  operation;  (e)  clarify  the 
impact  of  manufacturing  process  plans  on 
design;  and  (f)  establish  process  controls 
coordination  among  functions  (Hauser  and 
Clausing,  1988,  p.  63). 


Ernst  and  Young  innovated  QFD  ap¬ 
plied  to  the  paper  products  industry  dur¬ 
ing  1990,  where  they  included  importance 
weighting,  measured  correlation  among 
customer  requirements,  and  completed 
competitive  evaluations  (a.k.a.  “bench¬ 
marking”  (Juran  and  Gryna,  1993,  p.  255). 


Thiokol  Strate- 

Slc°P“ionS  "ONl«r  camiHiniM 

used  QFD  spe-  QFD  i.<l.du 

cifically  to  bet- ;  Aero|e|  Ordnance, 
ter  measure  and  iTT#  IBM,  Digital 
certify  its  parts  Equipment,  Texas 

suppliers,  and  Instruments, 
consequently  Chrysler,  General 
reduce  devel-  Meters,  Procter  and 

opment  time  to  Deere  * 

build  strategic  Cempany,  Peiareid, 
,  Rockwell  Interna- 

and  tactical  tiona|  Hughes  Air- 

weapon  system  * 
solid  rocket 
motors  (Guinta 
and  Praizler, 

1993,  p.  13). 

Other  companies  using  QFD  include 
Aerojet  Ordnance,  ITT,  IBM,  Digital 
Equipment,  Texas  Instruments,  Chrysler, 
General  Motors,  Procter  and  Gamble, 
Deere  &  Company,  Polaroid,  Rockwell  In¬ 
ternational,  Hughes  Aircraft,  and  Hewlett 
Packard  (Sanchez  et  al.,  1993,  p.  239).  Re¬ 
search  by  Guinta  and  Praizler  (1993,  p.  8) 
revealed  that  various  domestic  service  and 
manufacturing  companies  using  QFD  ex¬ 
perienced  50  percent  cost  reductions,  and 
33  percent  project  time  reductions. 

The  DoD  Joint  Strike  Fighter  Program 
(JSFP)  has  an  activity  referred  to  as  the 
Strategy-to-Task  Technology  QFD  II 
Analysis,  which  has  been  awarded  the 


American  Supplier  Institute  (ASI)  “Best 
Application”  Award,  recognizing  exem- 
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plary  use  of  QFD.  This  award  was  granted 
at  the  1995  ASI  Product  Development 
Symposium.  ASI  cited  this  QFD  II  analy¬ 
sis  as  “the  most  robust  aggressive  use  of 
QFD  to  analyze  weapon  system  require¬ 
ments  seen  to  date.”  The  award  was  pre¬ 
sented  by  Dr.  Genichi  Taguchi,  a  four-time 
Deming  Prize  winner  (JSFP,  1996a). 

QFD  has  been  successfully  used  in  a 
wide  variety  of  industries:  aircraft,  aero¬ 
space,  automobiles,  computer  software, 
construction  equipment,  copiers,  con¬ 
sumer  goods,  electronics,  paper  products, 
shipbuilding,  and  textiles  (Menon  et  al., 

1994).  The  lit¬ 
erature  review, 
taken  together, 
reliably  indi¬ 
cates  that  QFD 
is  deeply  inte¬ 
grated  into  our 
commercial  in¬ 
dustry  culture. 

United  States 
military  cost¬ 
ly  constrained  ef¬ 
fectiveness  is 
influenced  by 
our  quality  of 
organizing  and  deploying  technology  ac¬ 
cording  to  specific  functions.  Other  na¬ 
tions  that  compete  militarily  with  the 
United  States  are  evidencing  their  under¬ 
standing  of  this  (Brauchli,  1997,  p.  A14; 
Chen,  1997,  p.  A 15;  Fisher,  1996,  p.  A18). 
The  lessons  learned  from  the  competitive 
strategies  practiced  under  Secretary  of 
Defense  Casper  Weinberger  during  the 
Reagan  administration  are  not  lost  in  this 
era  characterized  by  aggressive  nations 
actively  seeking  technologies  providing 
greater  military  leverage. 


"QFD  has  been 
successfully  used  in  a 
wide  variety  of 
industries;  aircraft, 
aerospace,  automo¬ 
biles,  computer 
software,  construc¬ 
tion  equipment, 
copiers,  consumer 
goods,  electronics, 
paper  products, 
shipbuilding,  and 
textiles." 


Research  by  Pisano  and  Wheelwright 
demonstrates  that  outstanding  high-tech 
companies  such  as  Intel  and  Hewlett- 
Packard  have  integrated  their  product  de¬ 
velopment  skills  with  new  focus  on  pro¬ 
cess  development,  and  built  unique  sus¬ 
tainable  competitive  positions  without 
expending  more  resources  (1995,  p.  105). 
The  type  of  plan  chosen  does  make  a  dif¬ 
ference! 


How  Well-suited  Is  Quality 
Function  Deployment  to  DoD  CAIV? 


The  applicability  of  QFD  to  CAIV  is 
enhanced  through  the  instrumental  role  of 
integrated  product  and  process  develop¬ 
ment  (IPPD).  IPPD  is  a  philosophy  of  in¬ 
tegrating  all  acquisition  activities  through¬ 
out  the  program  life  cycle.  Integrated 
product  teams  (IPTs)  are  at  the  core  of 
IPPD;  IPTs  are  most  instrumental  to  CAIV 
development  and  implementation. 

A  standardized  structure  for  cost  IPT 
operations  is  desirable  for  common  imple¬ 
mentation  of  CAIV  initiatives  across  all 
DoD  programs.  System-level  cost  objec¬ 
tives,  in  turn  decomposed  to  the  sub-sys¬ 
tem  level,  are  key  technical  performance 
measures  shared  by  the  program  manager 
and  corresponding  IPTs.  Cost/Perfor¬ 
mance  IPTs  (CPIPTs)  are  empowered  to 
recommend  engineering  and  design 
changes  to  the  program  manager. 

IPPD  facilitates  IPTs  for  synthesizing 
acquisition  activities  throughout  the  pro¬ 
gram  life  cycle.  As  such,  IPTs  offer  DoD 
an  unprecedented  opportunity  to  imple¬ 
ment  QFD  as  an  interfunctional  planning 
and  communications  tool.  This  is  espe¬ 
cially  true  for  currently  planned  advanced 
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military  technology  implementation  pro¬ 
grams  that  require  demonstrating  a  clear 
path  toward  reducing  costs  as  well  as 
meeting  operational  requirements 
(Wollover  and  Koontz,  1996,  pp.  1-7). 

Illustration  of  Applying  QFD: 

Generic  Weapon  System  Design 

Now  we’ll  illustrate  the  application  of 
QFD  to  the  process  of  developing  a  ge¬ 
neric  weapon  system.  A  notional  weapon 
system  example  was  selected  to  provide 
adequate  design  complexity,  to  permit  a 
fairly  detailed  QFD  application  example. 
This  example  system  need  not  be  plat- 
form-specific;  it  is  most  broadly  consid¬ 
ered  deployable  to  strike  any  target  (e.g., 
underwater,  surface,  or  airborne)  from  any 
platform  (e.g.,  human,  vehicle,  aircraft, 
ship,  spacecraft). 

The  QFD  process  consists  of  the  fol¬ 
lowing  steps:  (a)  identifying  and  analyz¬ 
ing  customer  needs  and  requirements,  (b) 
identifying  TPMs,  (c)  benchmarking 
TPMs,  (d)  assigning  priority  to  customer 
requirements,  (e)  establishing  TPMs  to 
identify  specific  design  characteristics, 
and  (f)  evolving  TPMs  into  the  follow-up 
design  phase’s  requirements.  Actual  steps 
do  vary  in  the  literature  (Guinta  and 
Praizler,  1993;  Sanchez  et  al.,  1993; 
Menon  et  al.,  1994;  Verma  et  al.,  1996). 
The  above  steps  suit  our  example. 


Identify  and  Analyze 
Customer  Needs  and  Requirements 


Customer  need  is  defined  in  the  con¬ 
text  of  a  single  on-target  engagement.  Ini¬ 


tially,  customer  language  is  qualitative  and 
subjective,  imparting  vagueness  and  im¬ 
precision  to  the  early  weapon  system  de¬ 
sign.  For  example,  needs  such  as  maxi¬ 
mizing  mission  effectiveness,  maximizing 
affordability,  maximizing  supportability, 
minimizing  risk,  and  optimizing  person¬ 
nel  use  are  all  too  general  for  design  engi¬ 
neers  to  immediately  respond  to.  Hence 
these  fuzzy  statements  are  analyzed  and 
translated  into  more  specific  requirements 
to  better  understand  and  respond  to  the 
perceived  deficiency. 

The  first  two  columns  of  Table  1  illus¬ 
trate  these  translations.  For  example, 
“maximize  mission  effectiveness”  is  trans¬ 
lated  into  more  concrete  goals,  such  as 
“locate,  track,  reach,  and  destroy  target.” 
Developing  a  common  dictionary  for  the 
overall  QFD  model  aids  in  understanding 
user  requirements  in  light  of  later  tradeoff 
decisions  (Bregard  and  Chasteen,  1996, 
p.  172).  Once  identified,  similar  customer 
requirements  are  grouped  with  like  func¬ 
tional  items.  Referring  again  to  Table  1, 
note  how  the  five  general  customer  re¬ 
quirements  are  the  basis  of  the  grouping 
of  subsequent  more  concrete  requirement 
statements. 

Identify  Technical  Performance 
Measures 

TPMs  are  the  keys  to  estimating 
progress  for  the  weapon  system’s  design 
and  development.  As  “design-dependent 
parameters,”  TPMs  offer  various 
functionalities.  They  provide  visibility  into 
the  status  of  actual  versus  required  sys¬ 
tem  performance,  define  corresponding 
future  design  goals,  provide  guideposts  to 
evaluating  design  concepts  and  configu¬ 
rations,  provide  early  detection  of  perfor- 
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Table  1  •  Notional  Generic  Weapon  System  Objectives  Table 

CUSTOMER 

QUANTITATIVE 

REQUIREMENTS 

TPM 

REQUIREMENT 

Maximize 

Locate  target 

Motor  burnout  velocity 

(km/sec) 

mission 

Track  target 

Range 

(km) 

effectiveness 

Reach  target 

Maneuverability 

(Gi/ms) 

Destroy  target 

Data  processing  speed 

Mhz 

Data  reception  speed 

Kb/Sec 

Length  *  diameter 

M"2 

Mass 

kg 

Sensor  accuracy 

S/N 

Maximize 

Minimize  R&D  cost 

R&D 

Constant  year  $M 

affordabitty 

Minimize  production  cost 

Production 

Constant  year  $M 

Minimize  support  cost 

Minimize  operations  cost 

O&S 

Constant  year  $M 

Maximize 

Maximize  reliability 

MTBF 

Months 

supportability 

Failure  rate 

Failures /mission 

Engagement 

MTBM 

Months 

Maximize  maintainability 

Mean  prevent  maint.  time  -BITE  (MPMT-B) 

Minutes 

Mean  prevent  maint.  time  -ExTE  (MPMT-E) 

Minutes 

Mean  corn  maint.  time  (MCMT)  -  org.  level 

Minutes 

Minimize  risk 

Maximize  producibility 

Amount  of  major  modifications 
(Reintegrating  subsystems) 

Percent 

Amount  of  minor  modifications 
(Repackaging  subsystems) 

Percent 

Minimize  design  complexity 

Hardware  complexity 

No.  of  interfaces/No.  subsystems 

Software  complexity 

No.  of  interfaces/No.  subsystems 

Subsystems  integration  complexity 

No.  of  interfaces/No.  subsystems 

Optimize 

Maximize  operator  effectiveness 

Operator  response  times 

Seconds 

personnel 

Errors  per  mission  engagement 

No.  errors 

use 

Minimize  Support  Errors 

Errors  per  testing  event  series 

No.  errors 

Errors  per  maintenance  action 

No.  errors 

Optimize  anthropometric  factors 

Size  of  maintenance  access  panel  areas 

ln.xin.xin. 

Time  to  open  each  maintenance  access  panel 

Seconds 

Optimize  sensory  factors 

Each  maintenance  access  panel  lighted 

Lumens 

Color  coded  panels 

Indicate  tool  needs 

a  Ranking  Order  determined  on  basis  of  customer  perceived  relative  degree  of  shortfall  toward  existing  benchmark 

b  Because  Mission  Engagements  are  not  continuous,  it  is  readily  assumed  that  the  relationship  between  Reliability  and  Operating  Time  /  MTBF 

is  not  exponential.  Hence  MTBF  and  Failure  Rate  may  be  somewhat  more  Independently  specified  as  design  goals. 
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mance  problems  requiring  management 
attention,  assess  technical  impact  of  pro¬ 
posed  changes,  and  contrast  implications 
of  design  alternatives.  Consequently, 


TPMs  are  integral  to  the  program’s  risk 
management. 

At  this  early  stage  of  design,  TPMs  are 
key  parameters  that  are  under  the  control 


Table  2.  Notional  Generic  Weapon  System  Objectives  Table 
Benchmarking  of  Technical  Performance  Measures 
Pre-Rank-Ordering 


Technical 

Performance 

Measure 

Quantitative 

Requirement 

Current 

Benchmark 
(Competing  systems) 

Relative 

Importance 

Motor  burnout  velocity  (km/sec) 

2N 

N 

8 

Range  (km) 

1.5N 

N 

6 

Maneuverability  (Gl/ms) 

2N 

N 

8 

Data  processing  speed 

5N  Mhz 

N  Mhz 

3 

Data  reception  speed 

ION  Kb/sec 

N  Kb/sec 

3 

Length  *  diameter 

N  Meter  ^2 

N  Meter  ~  2 

1 

Mass 

.8N  Kg 

NKg 

1 

Sensor  accuracy 

2N:N  Signal/noise 

N:N  Signal/noise 

8 

R&D  (constant  year  $M) 

.9N  Dollars 

N  Dollars 

4 

Production  (constant  year$M) 

.8N  Dollars 

N  Dollars 

6 

O&S  (constant  year  $M) 

.7N  Dollars 

N  Dollars 

7 

MTBF 

.5N  Months 

N  Months 

2 

Failure  (F)  rate 

.5NF/  mission  engagement 

NF/  Mission  engagement 

2 

MTBM 

,5N  Months 

N  Months 

1 

Mean  prevent,  maint.  time  -BITE  (MPMT-B) 

.8N  Minutes 

N  Minutes 

1 

Mean  prevent,  maint.  time  -ExTE  (MPMT-E) 

,8N  Minutes 

N  Minutes 

1 

Mean  corn  maint.  time  (MCMT)  -Org  Level 

,8N  Minutes 

N  Minutes 

1 

Amount  of  major  modifications 

.5N% 

N  % 

7 

Amount  of  minor  modifications 

.5N% 

N  % 

3 

Hardware  complexity 

Sustain 

No.  of  Interfaces 

4 

Software  complexity 

Sustain 

No.  of  Interfaces 

4 

Subsystems  integration  complexity 

Sustain 

No.  of  Interfaces 

5 

Operator  response  times 

NSec 

NSec 

3 

Errors  per  mission  engagement 

.5*(0.N)  Errors 

O.N  Errors 

5 

Errors  per  testing  event  series 

.5*(0.N)  Errors 

O.N  Errors 

1 

Errors  per  maintenance  action 

.5*(0.N)  Errors 

O.N  Errors 

1 

Size  of  maintenance  access  panel  areas 

Sustain 

nin.  x  nin.xnin. 

1 

Time  to  open  each  maintenance  panel 

,8N  Seconds 

N  Seconds 

1 

Each  maintenance  access  panel  lighted 

1.5N  Lumens 

N  Lumens 

1 

Color  coded  panels 

Reflect  tool  needs 

Using  B&W  symbols  only 

1 
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of  the  design  team.  They  are  manipulated 
either  directly  or  indirectly  to  meet  cus¬ 
tomer  requirements.  TPMs  are  tangible 
and  describe  any  relevant  system  attribute 
in  measurable  terms. 

TPM  ratios  may  be  used.  An  example 
is  effectiveness-to-cost  ratios,  for  which 
a  very  wide  variety  of  options  may  be 
specified  (Wollover,  1991,  pp.  149-153). 
While  discrete  changes  in  design  measures 
leading  to  distinct  effectiveness  changes 
may  be  discerned,  effectiveness-to-cost 
ratios  may  be  normalized  so  equivalent 
comparisons  of  TPMs  may  be  made  for 
purposes  such  as  the  six  functions  men¬ 
tioned  at  the  beginning  of  this  section. 
Ratio  examples  are:  system  effectiveness 
to  life  cycle  cost,  or  reliability  to  devel¬ 
opment  cost.  Ratios  such  as  these  may  be 
specified  in  the  form  of  [gkD]  customer 
benefit  -/[gkD]cost,  to  facilitate  compari¬ 
son  of  relative  changes  among  alternative 
TPM  values. 

In  Table  1,  the  TPMs  in  the  third  col¬ 
umn  evolve  from  the  more  concretely  de¬ 
fined  customer  requirements  shown  in  the 
second  column.  The  fourth  column  dis¬ 
plays  specific  quantitative  requirements 
associated  with  each  TPM. 

Benchmark  Technical  Performance 
Measures 

Table  2  lists  the  TPMs  and  the  quanti¬ 
tative  requirement  (the  latter  being  the 
same  measure  found  in  the  fourth  column 
of  Table  1).  The  third  column  in  Table  2, 
“Current  Benchmark,”  holds  the  corre¬ 
sponding  quantified  TPMs  found  either  in 
the  predecessor  weapon  system  or  in  ei¬ 
ther  domestic  or  foreign  competing 
weapon  systems.  Consequently,  the  sys¬ 
tem  developers  would  like  to  surpass  these 
benchmarks. 


Prioritize  Customer  Requirements 

Various  system  requirements  will  likely 
conflict.  For  example,  adding  weapon 
speed  and  range  conflicts  with  minimiz¬ 
ing  development  and  production  costs. 
Consequently,  assuming  a  limited  budget, 
tradeoffs  are  inevitable.  The  issue  here  is 
on  what  basis  should  the  various  inter¬ 
dependent  tradeoffs  be  made.  To  help 
resolve  if  not  overcome  these  conflicts, 
the  requirements  are  assigned  relative 
weights  that  reflect  the  customer’s  priori¬ 
ties.  For  this  step,  there  is  little  substitute 
for  direct  customer  survey  techniques 
(Salomone,  1995,  p.  108),  although  appro¬ 
priate  weapon  system  operations  simula¬ 
tions  are  invaluable  for  enhancing  cus¬ 
tomer  decision  processes. 

Here  we  have  used  an  arbitrary  and  sys¬ 
tematic  process  to  assign  relative  weights, 
as  follows.  The  last  column  of  Table  2, 
“Relative  Importance,”  is  reserved  for  as¬ 
signing  customer  weights  to  TPMs.  The 
first  pass  through  the  entire  TPM  series 
assigned  a  weight,  equal  to  one,  to  all 
TPMs.  The  second  pass  entailed  assign¬ 
ing  a  relative  weighting  equal  to  two  for 
more  important  TPMs.  The  third  pass  as¬ 
signed  weights  of  three  to  those  progres¬ 
sively  more  important  TPMs,  and  so  on, 
until  the  sum  of  the  relative  importance 
measures  equaled  100.  Finally,  this  list  of 
TPMs  was  sorted  based  on  these  relative 
importance  measures;  Table  3  lists  these 
sorted  TPMs. 

The  above  ranking  procedure  is  suit¬ 
able  for  our  illustration;  more  rigorous 
prioritizing  procedures  are  available.  For 
example,  variations  of  the  commonly  ref¬ 
erenced  analytical  hierarchy  process 
(AHP)  are  cited  in  the  literature  (Armacost 
et  al.  1994,  p.  72;  Wasserman,  1993,  p. 
59;  Lyman,  1990,  p.  307).  These  proce- 
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Table  3*  Notional  Generic  Weapon  System  Obfectives  Table 
Prioritization  of  Technical  Performance  Measures 
Rank- Ordered  According  to  Priority 


Technical 

Performance 

Measure 

Quantitative 

Requirement 

Current 

Benchmark 
(Competing  Systems) 

Relative 

Importance 

Motor  burnout  velocity  (km/sec) 

2N 

N 

8 

Maneuverability  (Gl/ms) 

2N 

N 

8 

Sensor  accuracy 

2N:N  Signal/noise 

N:N  Signal/noise 

8 

O&S  (constant  year  $M) 

,7N  Dollars 

N  Dollars 

7 

Amount  of  major  modifications 

.5N% 

N% 

7 

Range  (km) 

1.5N 

N 

6 

Production  (constant  year  $M) 

.8N  Dollars 

N  Dollars 

6 

Subsystems  integration  complexity 

Sustain 

No.  of  Interfaces 

5 

Errors  per  mission  engagement 

.5*  (O.N)  Errors 

O.N  Errors 

5 

R&D  (constant  year  $M) 

.9N  Dollars 

N  Dollars 

4 

Hardware  complexity 

Sustain 

No.  of  Interfaces 

4 

Software  complexity 

Sustain 

No.  of  Interfaces 

4 

Data  processing  speed 

5N  Mhz 

N  Mhz 

3 

Data  reception  speed 

ION  Kb/Sec 

N  Kb/Sec 

3 

Amount  of  minor  modifications 

.5N  % 

N  % 

3 

Operator  response  times 

NSec. 

NSec 

3 

MTBF 

,5N  Months 

N  Months 

2 

Failure  (F)  rate 

.5N  F/ Mission  engagement 

N  F  /  Mission  engagement 

2 

Length  *  diameter 

N  Meter"  2 

N  Meter"  2 

1 

Mass 

.8N  Kg 

N  Kg 

1 

MTBM 

.5N  Months 

N  Months 

1 

Mean  prevent,  maint.  time  -BITE  (MPMT-B) 

.8N  Minutes 

N  Minutes 

1 

Mean  prevent,  maint.  time  -ExTE  (MPMT-E) 

.8N  Minutes 

N  Minutes 

1 

Mean  corr  maint.  time  (MCMT)  -org.  level 

,8N  Minutes 

N  Minutes 

1 

Errors  per  testing  event  series 

,5*(0.N)  Errors 

O.N  Errors 

1 

Errors  per  maintenance  action 

.5*(0.N)  Errors 

O.N  Errors 

1 

Size  of  maintenance  access  panel  areas 

Sustain 

Nin.  x  N  in.  x  N  in. 

1 

Time  to  open  each  maintenance  access  panel 

,8N  Seconds 

N  Seconds 

1 

Each  maintenance  access  panel  lighted 

1.5N  Lumens 

N  Lumens 

1 

Color  coded  panels 

Reflect  tool  needs 

Using  B&W  symbols  only 

1 

dures  essentially  are  driven  by  using  so¬ 
phisticated  customer  query  techniques  to 
develop  and  assign  explicit  weighting 
variables  that  represent  customer  priori¬ 
ties.  These  techniques,  while  ‘‘method¬ 


ologically  intense,”  should  result  in  fairly 
unambiguous  communication  of  which 
customer  inputs  most  greatly  influence 
QFD. 
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Table  4.  First-Order  Quality  Function  Deployment  Correlation  Matrix 


Motor  burnout  velocity  (km/sec) 

Range  (.km) 

Maneuverability  (GVms) 

Data  processing  speed  (mhz) 

Data  reception  speed  (kb/sec) 

Length  *  diameter 
Mass  (kg) 

Sensor  accuracy  (S/N) _ 

R&D  expenditure  (constant  year  $M) 

Production  expenditure  (constant  year  $M) 

0&S  expenditure  (constant  year  $M) 

MTBF  (months) 

Failure  rate  {failures/mission  engagements) 

MTBM  (Months) 

Mean  prevent,  maint.  time  -  BITE  (MPMT-B)(min) 
Mean  prevent  maint.  time  -  ExTE  (MPMT-E)(min) 

Mean  com  maint.  time  (MCMT-B)  -  org.  level  (min) 
Amount  of  major  modification  (%) 

Amount  of  minor  modificaiton  (%) 

Hardware,  software,  integ.  complexity  (No.  interfaces) 
Operator  response  times  (sec) 

Errors  per  mission  engagement  (No.  errors) 

Errors  per  testing  event  series  (No.  errors) 

Errors  per  maintenance  action  (No.  errors) 

Size  of  maintenance  access  panel  areas  (in.  x  in.) 

Time  to  open  each  maintenance  access  panel  (sec.) 
Each  maintenance  access  panel  lighted  (lumens) 

Color  coded  panels) 

RELATIVE  IMPORTANCE 
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Establishing  TPMs  to  Identify  Specific 
Design  Characteristics 


All  TPMs  are  considered  on  an  inte¬ 
grated  basis  using  the  QFD  correlation 
matrices.  This  is  the  first  opportunity  to 
integrate  all  requirements,  including  effec¬ 
tiveness,  cost,  operations,  and  logistics 
support  into  the  mainstream  design  and 
development  process. 

Configure  the  QFD  matrix.  Customer 
requirements  from  the  first  two  columns 
of  Table  1  are  set  as  the  “customer  desired 
attributes”  (Table  4,  the  first-order  QFD 
matrix,  left-hand  section).  These  are  the 
“whats”  to  be  satisfied.  In  response  to 
these  requirements,  TPMs  from  Tables  1 
through  3  are  positioned  along  the  top  of 
the  matrix.  These  TPMs  are  the  “hows,” 
to  the  extent  that  they  support  customer 
requirements. 

Correlate  customer  requirements 
With  TPMs.  This  is  the  key  step  of  the 
QFD  process.  It  involves  populating  the 
correlation  matrix  to  reflect  program-di¬ 
rected  or  otherwise  inherent  cause  and  ef¬ 
fect  relationships.  Each  TPM  is  analyzed 
in  terms  of  the  extent  of  its  influence  on 
customer  requirements. 

Varying  relative  levels  of  this  correla¬ 
tion  are  notionally  depicted  in  the  example 
correlation  matrix  (Table  4),  ranging  from 
a  value  of  +3,  the  maximum  positive  cor¬ 
relation,  depicted  in  the  matrix  as  3,  to  - 
3,  the  maximum  negative  correlation,  de¬ 
picted  in  the  matrix  as  (3).  We  especially 
note  that  these  values  do  not  simply  cor¬ 
relate,  but  rather  indicate  the  degree  to 
which  the  TPMs  support  the  customer  re¬ 
quirements.  Three  examples  follow;  their 
occurrences  in  the  first-order  QFD  matrix 
shown  in  Table  4  are  highlighted  using 


bold  borders  surrounding  the  relevant  cor¬ 
relation  cells. 

Example  1:  Note  the  negative  correla¬ 
tions  between  the  TPM  mass  and  the  cus¬ 
tomer  requirements  for  minimizing  R&D 
and  production  cost.  Here,  the  matrix  is 
not  negatively  correlating  mass  with  cost, 
but  with  the  customer  requirement  of 
minimizing  cost. 

Example  2:  An  interesting  example  oc¬ 
curs  where  all  six  Supportability  TPMs  are 
negatively  correlated  with  R&D  and  pro¬ 
duction  costs,  but  are  more  positively  cor¬ 
related  with  operations  and  support  costs. 
This  reflects  the  normative  view  purported 
by  C AIV  proponents  that  greater  up-front 
investment  in  supportability  is  warranted 
for  ultimately  reducing  overall  life  cycle 
costs  through  disproportionately  greater 
savings  in  the  operations  and  support 
phase  of  the  program.  This  example  par¬ 
ticularly  helps  to  emphasize  QFD’s  util¬ 
ity  in  identifying  clusters  of  interaction 
elements. 

Example  3:  The  last  example  occurs  to 
illustrate  the  relatively  minor  yet  real  con¬ 
tribution  that  increasing  personnel  perfor¬ 
mance  (e.g.,  greater  human  response  time, 
fewer  errors,  reduced  maintenance  dura¬ 
tions)  contributes  to  overall  system  per¬ 
formance  reliability.  This  example  is  in¬ 
tended  to  call  attention  to  the  high  value- 
added  human  machine  interface  (HMI) 
avenues  to  cost  reduction  such  as  anthro¬ 
pometric  factors,  as  described  generally 
by  Blanchard  and  Fabrycky  (1990,  pp. 
435-440),  and  as  directly  applied  to  ad¬ 
vanced  aerospace  design  as  described  by 
Reed  (1994,  pp.  54-59). 

General  evaluation  of  the  correlation 
matrix.  Empty  matrix  rows  represent  un¬ 
addressed  customer  requirements.  Where 
this  is  so,  the  set  of  TPMs  is  reevaluated. 
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and  additional  TPMs  are  specified  where 
needed.  By  contrast,  empty  columns  in  the 
matrix  indicate  design  or  other  develop¬ 
ment  actions  that  are  not  traced  to  any 
customer  requirement;  they  may  indicate 
either  under-leveraged,  redundant,  or  un¬ 
necessary  system-level  design  require¬ 
ments  (Verma  et  al.,  1995,  pp.  38).  Other 
matrix  evaluation  strategies  not  covered 
by  the  above  example  could  involve  the 
following  five  avenues: 

•  Contrast  complimentary  technical  so¬ 
lutions  versus  each  other,  to  assess  the 
degree  they  conflict  (Hartzell  and 
Schmitz,  1996,  p.  36).  Correlations 
among  design  inputs  may  be  shown 
using  a  triangular  table  at  the  top  of  the 
matrix.  However,  care  is  needed  to  vali¬ 
date  the  true  interactions  between  de¬ 
sign  inputs,  as  many  of  these  interac¬ 
tions  may  strengthen  or  weaken  as  the 
design  evolves  (Maisel,1996,  p.  16). 

•  Evaluate  the  functional  (cause-effect) 
relationships  among  concurrent  activi¬ 
ties  to  determine  not  only  how  flex¬ 
ible  the  overall  development  process 
is,  but  where  additional  flexibility  is 
most  needed  to  maintain  process  re¬ 
sponsiveness  to  customer  requirements 
volatility  (Jordan  and  Graves,  1995,  pp. 
577-583). 

•  Cooper  and  Chew  argue  that  it  is  in¬ 
sufficient  to  focus  on  customers;  com¬ 
petitors  are  a  parallel  concern  (1996, 
p.  95).  Expand  the  matrix  to  focus  on 
competitors  as  well  as  customers,  us¬ 
ing  key  mission  or  other  customer  sat¬ 
isfaction  TPMs.  Use  existing  competi¬ 
tor  TPMs  in  a  bench-marking  fashion, 
as  illustrated  earlier. 


•  Thurston  and  Locascio  (1993,  p.  208- 
213)  use  multiattribute  utility  theory  to 
interpret  QFD  matrices  as  a  general  for¬ 
mulation  of  a  design  optimization  prob¬ 
lem.  Customer  requirements  are  ex¬ 
pressed  as  constraint  functions,  and 
tradeoffs  among  design  attributes  are 
formally  specified  as  sets  of  variables 
whose  optimal  values  are  solved  using 
selected  mathematical  optimization 
models  (p.  211). 

•  Sanchez  et  al.  (1993,  pp.  244-249)  dis¬ 
play  perhaps  the  most  creative  and  pro¬ 
ductive  QFD  application.  They  show 
matrix  appendages  containing  trend 
line  analyses  of  data  populating  the 
matrix,  and  separately  illustrate  iterat¬ 
ing  successive  matrices  to  the  extent 
of  serving  inputs  to  statistical  process 
control.  Both  of  these  enhancements 
help  take  QFD  beyond  the  realm  of  a 
cognitive  tool  to  that  of  hard  empirical 
data  generator. 

Other  value-added  assessments  from 
checking  the  correlation  matrix  are  likely. 
Well-populated  QFD  matrices  permit  syn¬ 
ergistic  insights  particular  to  a  program’s 
chief  concerns. 

Evolve  TPMs  Into  the  Next  Design 
Phase's  Requirements 

Table  5  illustrates  the  transition  of  the 
“hows”  in  the  first-order  matrix  to  the 
“whats”  in  the  second-order  matrix.  This 
series  of  steps,  where  the  TPM  outputs  of 
a  «th-ordered  matrix  become  input  to  the 
successive  «th  +1 -ordered  matrix,  as  the 
design  resolution  is  enhanced,  until  sys¬ 
tem  design  detail  has  ideally  progressed 
to  the  point  where:  (a)  all  significant  de¬ 
sign  tradeoffs  are  defined  and  resolved, 
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Table  5.  Second- Order  Quality  Function  Deployment 
Correlation  Matrix 


TECHNICAL  ENGINEERING  CHARACTERISTICS 

Motor  thrust  (Newtons) 

Total  missile  Available  fuel  mass  (kg)  j 

Missile  divert  thruster  thrust  acceleration  (m/s2)| 

COTS  processor  generation  upgrad  (200  Mhz) 

Missile  uplink-receive  antenna  gain  (watts) 

Miniaturization  techniques  j 

Selection  of  lighter  materials  | 

Peak  transmitted  power  (watts) 

RELATIVE  IMPORTANCE  | 

MAXIMIZE 

Motor  burnout  velocity  (km/sec) 

D 

E3 

2 

2 

8 

MISSION 

Range  (km) 

Q 

El 

n 

a 

a 

6 

EFFECTIVENESS 

Maneuverability  (Gl/ms) 

D 

B 

H 

e 

a 

m 

KE 

D 

El 

Data  processing  speed  (MHz) 

D 

M 

m 

Data  reception  speed  (Kb/sec) 

a 

□ 

D 

D 

El 

Length  *  diameter  (m  *  m) 

n 

K3 

a 

a 

U 

Mass  (kg) 

D 

El 

■ 

a 

ii 

El 

Sensor  accuracy  (S/N) 

D 

a 

n 

B 

El 

TECHNICAL  DIFFICULTY  (10  =  Most  Difficult) 

D 

El 

n 

D 

D 

a 

a 

D 

IMPUTED  IMPORTANCE  (10  =  Most  Important) 

a 

D 

II 

D 

a 

a 

a 

D 

(b)  specific  subsystem  or  component  pack¬ 
aging  is  determined  and  tested,  so  that  (c) 
overall  program  risk  is  reduced  to  accept¬ 
able  levels. 

Third-,  fourth-,  fifth-,  etc. -order  QFD 
matrices  are  preferred  for  translating  cus¬ 
tomer  requirements  into  highly  detailed 
subsystem  attributes,  or  even  detailed  con¬ 
trol  of  operations  (Menon  et  al.  1994,  p. 
94).  For  diverse  examples  of  progressive 
QFD  translation  matrix  series  used  to 
translate  the  “voice  of  the  customer”  into 
the  more  evolved  “voice  of  the  engineer,” 
see  Guinta  and  Praizler  ( 1 993),  Hauser  and 
Clausing  (1988),  Sanchez  et  al.  (1993), 
and  Sage  (1992).  The  number  of  transla¬ 
tion  matrices  is  influenced  by  the  com¬ 


plexity  and  diversity  of  the  program,  in 
combination  with  the  degree  of  required 
design  detail.  While  translation  matrices 
content  may  vary  widely,  they  all  do  have 
a  similar  structure. 

Using  QFD  to  Benefit 
Implementing  CAIV 


QFD’s  multi-attribute  structure  can  sys¬ 
tematically  capture  data  and  interrelate  it 
in  a  variety  of  tailored  arrangements.  This 
enables  higher  quality  integrated  program 
analysis  and  evaluation  (including  cost 
and  effectiveness  analysis)  earlier  in  the 
weapon  system  life  cycle.  With  QFD’s  col- 
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lective  knowledge,  program  managers  can 
less  ambiguously  evaluate  what  technolo¬ 
gies  or  other  initiatives  will  fit  in  and  ad¬ 
vance  the  program. 

QFD  facilitates  comprehensively  dis- 
playing  rela¬ 
tionship  nodes 

"OfD  Is  a  procedure-  a  cost  and 

erieatedyet  noncost  vari. 

nonmechanistic  t  l 

enabling  lechnolegy  ab  es'  1S  en" 
for  new  program  courages  struc- 

development."  tured  analyses 

to  yield  im¬ 
proved  rank 
orderings  into  which  cost  reduction  op¬ 
portunities  due  to  earlier  discovery  and 
resolution  of  conflicts  are  most  significant, 
before  large  shares  of  system  life  cycle 
cost  become  locked  in  during  the  earliest 
program  phases. 

Also,  there  is  perhaps  no  better  tool  to 
ascertain  whether  the  degree  of  system 
definition  and  development  is  commen¬ 
surate  with  requirements  determination,  or 
alternatively,  whether  requirements  deter¬ 
mination  is  lagging  behind  system  speci¬ 
fication  and  development. 

The  traditional  system  engineering  pro¬ 
cess  provides  a  standardized  “top-down” 
context  comprehensively  to  apply  QFD  to 
program  management,  as  described,  for 
example,  by  Blanchard  and  Fabrycky 
(1990,  p.  22,  50).  It  consists  of:  concep¬ 
tual  design  and  advanced  planning,  pre¬ 
liminary  systems  design  and  advanced  de¬ 
velopment,  and  detail  system  design  and 
development. 

Applying  QFD  through  sound  system 
engineering  principles  will  allow  greater 
exploitation  of  modem  manufacturing 
processes  and  controls.  Marshall  and  Van 
der  Ha  ( 1 996,  pp.  2 1 8-226)  provide  a  per¬ 


tinent  beneficial  example  of  the  system  en¬ 
gineering  approach  applied  to  designing 
space  system  ground  segments  to  reduce 
operations  costs. 

QFD  provides  a  consistent  robust  struc¬ 
ture  to  arrange  interactions  among  cross¬ 
functional  team  members.  As  organiza¬ 
tions  gain  experience  with  QFD,  the  model 
becomes  a  source  of  historical  informa¬ 
tion  and  “hard-wired”  corporate  memory. 
This  promotes  growing  an  integrated  prod¬ 
uct  team-facilitating  learning  curve.  Thus, 
an  expected  output  of  implementing  QFD 
is  to  advance  the  efficiency  of  the  organi¬ 
zation,  especially  for  better  controlling  the 
flow  of  IPT  interactions,  while  safeguard¬ 
ing  against  organizational  de-evolution 
due  to  loss  of  corporate  memory. 


Summary 


QFD  is  a  procedure-oriented  yet 
nonmechanistic  enabling  technology  for 
new  program  development.  It  provides  a 
structured  framework  that  uses  TPMs  to 
ensure  that  customer  needs  are  deployed 
into  all  phases  of  design,  development, 
production,  and  operations.  This  frame¬ 
work  drives  the  process  of  developing  a 
road  map  showing  how  key  steps  from 
design  to  manufacturing,  operations,  and 
support  interact  at  various  levels  to  fulfill 
customer  requirements.  This  road  map 
promotes  documenting  overall  system 
logic,  reflected  by  a  series  of  interrelated 
matrices  that  translate  customer  needs  into 
process  and  product  characteristics.  Well- 
documented  QFD  matrices  provide  a  flex¬ 
ible  dynamic  communication  vehicle  of 
prior,  present,  and  future  actions.  Thus, 
QFD  provides  a  communications  tool  to 
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accelerate  building  better  relationships  and 
promote  trust  among  cross-functional 
team  members  earlier  in  the  system  life 
cycle. 

QFD  is  a  team-building,  consensus-ori¬ 
ented,  flexibly  disciplined  approach  that 
structures  synthesizing  new  ideas.  It  works 
as  a  cognitive  map  to  ease  communica¬ 
tion  of  evolving  knowledge  across  cost 
performance  integrated  product  team  ele¬ 
ments — enhancing  their  work  in  an  inte¬ 
grated  fashion  to  give  customers  what  they 
are  asking  for.  QFD  can  apply  throughout 
steps  ranging  from  requirements  determi¬ 
nation  through  design  through  delivery 
through  operations  and  support. 

Incorporating  QFD  in  the  design  helps 
to  identify  critical  driving  design  attributes 
that  should  be  addressed  up  front,  where 
they  most  greatly  benefit  design  evolution. 


QFD  models  integrate  data  from  many 
areas:  customer  requirements,  strategic 
plans,  engineering  expertise,  cost,  mission 
effectiveness,  production  capability,  logis¬ 
tic  support,  hardware  and  software  reli¬ 
ability,  and  operations  and  maintenance. 
The  QFD  model  presents  these  data  in  a 
side-by-side  format  showing  relationships, 
correlations,  and  conflicts.  It  can  show, 
where  needed,  tradeoffs  among  require¬ 
ments,  resources,  and  organizations.  A 
single-page  QFD  matrix  can  easily  com¬ 
municate  what  would  require  a  large  num¬ 
ber  of  text  pages. 

By  better  connecting  developer,  user, 
and  supporter,  QFD  facilitates  making 
CAIV  tradeoffs  among  performance, 
schedule,  and  cost.  QFD’s  iterative  nature 
of  using  progressively  refined  TPMs  clari¬ 
fies  system  design  detail  to  where  signifi- 


Figure  1.  An  Iteration  off  the  Ouality  Function  Deployment  Process 
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cant  design  tradeoffs  are  defined  and  re¬ 
solved,  and  subsystem  function  and  pack¬ 
aging  are  determined  and  tested.  This  re¬ 
duces  program  risk.  Consequently, 
through  exploiting  detailed  coordinated 
TPMs,  QFD  functions  as  a  key  part  of  pro¬ 
gram  risk  management.  Figure  1  general¬ 
izes  a  single  iteration  of  the  overall  QFD 
sequence. 

One  of  the  most  challenging  system 
development  steps  is  sustaining  the  trans¬ 
lation  of  subjective  evolutionary  customer 
requirement  statements  into  objective  en¬ 
gineering  performance  measures.  Hartzell 
and  Schmitz  (1996,  p.  36)  point  out  that 
volatile  customer  requirements  are  a  sig¬ 
nificant  developmental  program  risk 
driver.  Here,  QFD  may  be  used  to  relate 
different  aspects  of  design,  test,  manufac¬ 
turing,  cost,  reliability,  and  technology 
while  both  maintaining  and  archiving  the 
changing  customer’s  voice  as  the  product 
development  driving  force.  In  this  sense, 
QFD  is  usable  as  a  DoD-equivalent  of 
sound  commercial  business  practices  that 
do  not  lose  sight  of  the  fact  that  the  devel¬ 
oping  voice  of  the  customer  is  critical  to 
successful  implementation. 

DoD  has  recognized  QFD  as  a  viable 
option  in  complex  analyses  involving  in¬ 
tegrated  product  teams.  QFD  has  been 
acknowledged  as  a  process  enabling  true 
understanding  of  user  requirements  and 
expectations,  and  documenting  the  best 
approach  to  satisfy  requirements.  DoD  has 
cited  QFD  as  a  way  to  track  the  expected 
tradeoffs  through  determining  require¬ 


ments,  (design  decisions,  production,  and 
support  (OUSD[A&T],  1996,  pp.  2-5, 6). 

No  single  management  tool  is  a  pana¬ 
cea.  DoD  acquisitions  heavily  dependent 
on  integrated  product  teams  will  benefit 
from  QFD.  It  is  a  strong  tool  for  structur¬ 
ing  IPT  processes  to  comprehensively 
identify  what  to  do,  coordinate  actions  and 
their  interfaces,  monitor  all  tradeoffs 
among  activities,  and  understand  evolu¬ 
tions  of  program  features  and  interrela¬ 
tionships.  QFD  imposes  a  self-revealing 
logic  and  structure  to  program  development. 

Implementing  QFD  emphasizes  the  re¬ 
quirement  that  IPT  members  take  time  to 
learn  other  functional  areas’  terminology 
and  develop  a  common  definition  of  terms, 
to  build  renaissance  multidisciplinary 
teams.  It  is  best  to  set  QFD  use  objectives 
that  stretch  organizations,  not  break  them. 

Upper-level  management  may  benefit 
from  becoming  familiar  with  QFD.  This 
familiarity  can  furnish  the  benefit  of  un¬ 
derstanding  what  questions  to  ask  to  evoke 
useful  information  from  the  QFD  frame¬ 
work.  A  chief  example  of  this  is  the  QFD 
matrix  revealing  new  relationships  among 
cost  and  performance  variables  that  indi¬ 
cate  emerging  cost  reduction  responsibili¬ 
ties  associated  with  implementing  new 
weapon  system  technologies.  This  infor¬ 
mation,  revealed  by  QFD,  may  be  then 
used  to  evolve  management  strategies  that 
support  organization  efforts  in  a  manner 
that  guide  development  toward  optimiz¬ 
ing  system  cost-effectiveness. 
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COST  ESTIMATING  RISK  AND  COST 
ESTIMATING  UNCERTAINTY  GUIDELINES 

Timothy  R  Anderson  and  Jeffrey  5.  Cherwonik 


The  Memorandum  of  Agreement  signed  by  the  Assistant  Secretaries  of  the 
Navy  for  Research,  Development,  and  Acquisition  (ASN[RD&A])  and  for 
Financial  Management  and  Comptroller  (FM&C)  in  June  1996  committed  the 
Naval  Center  for  Cost  Analysis  (NCCA)  to  improve  cost  analyses  by  helping 
program  managers  prepare  better  cost  estimates.  Recent  computing  advances 
make  development  of  meaningful  risk  and  uncertainty  analyses  easier,  and 
these  analyses  can  help  managers  do  their  job  better. 


The  Memorandum  of  Agreement 
signed  by  the  Assistant  Secretaries 
of  the  Navy  for  Research,  Develop¬ 
ment,  and  Acquisition  (ASN[RD&A])  and 
for  Financial  Management  and  Comptrol¬ 
ler  (FM&C)  on  June  14, 1996,  committed 
the  Naval  Center  for  Cost  Analysis 
(NCCA)  to  “contribute  to  a  more  efficient 
Department  of  the  Navy  (DON)  cost 
analysis  process  by  assisting  program 
managers  prepare  high-quality  cost  esti¬ 
mates  for  the  acquisition  chain  of  com¬ 
mand.  ...”  One  very  important  cost  analy¬ 
sis  issue  that  has  received  limited  atten¬ 
tion  in  the  past  by  both  NCCA  and  the 
program  managers  is  “cost  estimating  risk 
and  uncertainty.” 

Historically,  program  office  estimates 
(POEs)  as  well  as  independent  cost  esti¬ 
mates  (ICEs)  have  emphasized  point 
rather  than  range  estimates.  With  recent 


advances  in  computing  capability,  it  has 
become  quite  easy  to  develop  meaningful 
risk  and  uncertainty  analyses  that  can  pro¬ 
vide  significant  insight  to  program  man¬ 
agers  and  milestone  decision  authorities 
(MDAs). 

This  article  will  explain  why  we  should 
analyze  cost  estimating  risk  and  uncer¬ 
tainty,  delineate  responsibilities,  describe 
the  procedures  required,  and  help  clarify 
the  process  using  a  sample  problem. 


Background 


Why  Analyze  Cost  Estimating  Risk  and 
Uncertainty? 

The  typical  DoD  life  cycle  cost  estimate 
(LCCE)  is  developed  by  calculating  the 
estimated  cost  of  each  of  several  work 
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breakdown  structure  elements  and  then 
adding  them  to  derive  a  total  LCCE.  If  the 
cost  estimate  for  each  work  breakdown 
structure  element  represents  the  “best 
guess”  of  the  cost  for  that  particular  ele¬ 
ment,  then  the  sum  of  the  cost  estimates 
for  each  element  represents,  approxi¬ 
mately,  the  “best  guess”  of  the  cost  esti¬ 
mate  for  the  whole  system.  Right?  Wrong! 

The  above  procedure  has  been  in  use 
for  years.  But  the  LCCE  that  results  from 
this  procedure  is  virtually  guaranteed  to 
be  wrong!  Assuming  the  estimate  for  each 
work  breakdown  structure  element  repre¬ 
sents  the  mean  or  average  cost  for  that  el¬ 
ement,  then  the  only  thing  one  can  posi¬ 
tively  say  about  the  resulting  total  cost 
point  estimate  is  that  it  is  the  most  likely 
cost  out  of  a  practically  infinite  number 
of  possible  costs. 

Moreover,  if  all  cost  data  come  from  a 
symmetric  population  (which  they  rarely 
do),  then  one  can  say  that  the  total  cost 
point  estimate  represents  the  50th  percen¬ 
tile  cost.  The  interpretation  of  this  is  that 
the  LCCE  actually  says  “there  is  a  50  per¬ 
cent  chance  that  the  life  cycle  cost  will  be 
less  than  the  point  estimate;  likewise,  there 
is  a  corresponding  50  percent  chance  that 


the  life  cycle  cost  will  be  greater  than  the 
point  estimate.”  Yet,  unfortunately,  this 
estimate  says  nothing  about  the  range  of 
possible  costs.  Is  the  estimate,  say,  $500 
million  plus  or  minus  $10  million?  Or  is 
the  estimate  $500  million  plus  or  minus 
$400  million?  Obviously,  this  information 
could  be  of  vital  interest  to  a  program  man¬ 
ager  or  a  milestone  decision  authority. 

Hire's  What  the  CAIG 
Has  to  Say  About  It 

The  Cost  Analysis  Improvement  Group 
(CAIG)  has  delineated  its  own  ideas  con¬ 
cerning  cost  estimating  uncertainty  in 
DoD  5000.4-M,  “Cost  Analysis  Guidance 
and  Procedures.”  In  this  document  the 
CAIG  says: 

Areas  of  cost  estimating  uncer¬ 
tainty  will  be  identified  and  quan¬ 
tified.  Uncertainty  will  be  quan¬ 
tified  by  the  use  of  probability 
distributions  or  ranges  of  cost. 

The  presentation  of  this  analysis 
should  address  cost  uncertainty 
attributable  to  estimating  errors; 
e.g.,  uncertainty  inherent  with 
estimating  costs  based  on  as- 
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sumed  values  of  independent 
variables  outside  data  base 
ranges,  and  uncertainty  attributed 
to  other  factors,  such  as  perfor¬ 
mance  and  weight  characteristics, 
new  technology,  manufacturing 
initiatives,  inventory  objectives, 
schedules,  and  financial  condition 
of  the  contractor.  The  probability 
distributions,  and  assumptions 
used  in  preparing  all  range  esti¬ 
mates,  shall  be  documented. . . 

Clearly  then,  there  is  well-documented 
interest  in  cost  estimating  uncertainty  and 
risk  at  the  highest  levels  of  DoD. 

What  Is  the  Difference  Between 
Risk  and  Uncertainty? 

Ask  any  two  people  for  the  definitions 
of  risk  and  uncertainty  and  you  will  likely 
get  two  different  answers.  In  addition, 
definitions  vary  among  organizations. 
However,  in  the  context  of  cost  estima¬ 
tion,  it  is  very  important  to  have  a  precise 
definition  of  these  two  terms.  NCCA  has 
defined  the  two  terms  in  the  following 
way. 

Cost  estimating  uncertainty.  Uncer¬ 
tainty  reflects  one’s  confidence  in  the  point 
estimate.  Cost  estimating  uncertainty 
arises  from  the  inaccuracies  inherent  in  the 
cost  estimating  methodologies.  For  ex¬ 
ample,  one  might  estimate  a  work  break¬ 


down  structure  element  using  a  cost  esti¬ 
mating  relationship  (CER)  that,  based  on 
its  underlying  data,  is  accurate  to  within 
plus  or  minus  some  percentage.  Consider 
the  following  CER. 


Cost  (FY96$K)  -  3.06  x  (Weight  in  lbs)0551 
Standard  Error -0.20  (+22.1%,  - 1  8.1%) 


In  this  example,  if  the  weight  of  the 
object  being  estimated  is  100  pounds,  then 
the  estimated  cost  would  range  from 
$31.7K  to  $47.3K.  The  uncertainty  in  the 
estimate  is  captured  by  specifying  the 
range  (in  this  case  $31.7K  to  $47.3K)  in 
which  the  true  cost  of  the  object  is  likely 
to  occur  based  on  inaccuracies  in  the  cost 
estimating  methodology. 

Cost  estimating  risk.  Risk  reflects 
one’s  confidence  in  the  input  parameters 
used  to  develop  a  cost  estimate.  Cost  esti¬ 
mating  risk  arises  from  the  inaccuracies 
inherent  in  the  programmatic  assumptions 
or  technical  data  used  as  inputs  to  CERs. 
Consider  the  CER  shown  previously. 


Cost  (FY96$K)  -  3.06  x  (Weight  in  lbs)0  551 
Standard  Error -0.20  (+22.1%,  -1  8.1%) 


If  the  weight  of  the  object  being  esti¬ 
mated  is  100  pounds  plus  or  minus  5 
pounds,  then  there  exists  another  source 
of  cost  estimating  error.  First,  the  analyst 
has  to  account  for  the  risk  associated  with 


Table  I.  Estimate  Containing  Elements  of  Risk  and  Uncertainty 


CER  -18.1% 

BASELINE  CER 

CER +  22.1% 

95  lbs 

$30.8K 

$37.6K 

$45. 9K 

100  lbs 

$31.7K 

$38. 7K 

$47.3  K 

105  lbs 

$32. 6K 

$39.8K 

$48. 6K 
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the  variance  in  the  input  parameter  (5 
pounds);  then  the  analyst  must  deal  with 
the  uncertainty  in  the  CER  (+22.1%,  - 
18.1%).  Table  1  shows  the  steps  needed 
to  get  at  the  final  answer. 

In  this  example,  the  estimated  cost 
would  range  from  $30.8K  to  $48.6K  after 
considering  both  uncertainty  and  risk. 
Notice  the  wider  range  associated  with 
both  uncertainty  and  risk  compared  to  the 
range  associated  with  uncertainty  alone. 


Responsibilities 


Since  cost  estimates  are  now  typically 
done  by  integrated  product  teams  (IPTs), 
the  responsibility  for  gathering  data  and 
documenting  areas  of  risk  and  uncertainty 
will  in  most  cases  rest  with  the  Cost  IPT 
(CIPT).  Exactly  which  analyst  performs 
which  function  will  be  decided  within 
each  CIPT. 

Ordinarily,  the  cost  analyst  will  be  re¬ 
sponsible  for  selecting  the  methodology 
for  estimating  the  cost  of  each  work  break¬ 
down  structure  element.  An  important  part 
of  this  responsibility  is  to  ensure  the  sta¬ 
tistics  (uncertainty)  associated  with  the 
cost  estimating  methodologies  are  known 
or  are  quantifiable.  Often,  the  cost  ana¬ 
lyst  will  estimate  cost  with  a  single  point 
analogy  or  an  engineering  buildup  for 
which  no  apparent  statistics  exist.  In  these 
cases,  the  analyst  should  make  every  ef¬ 
fort  to  go  back  to  the  source  of  the  esti¬ 
mate  and  obtain  a  subjective  probability 
or  range  assessment  for  these  costs.  As  a 
minimum,  the  analyst  should  consider  the 
variability  reflected  in  previous  cost  esti¬ 
mates  of  analogous  systems.  In  addition, 
although  any  CIPT  analyst  could  perform 


the  task,  the  NCCA  analyst  should  be  re¬ 
sponsible  for  developing  the  risk  and  un¬ 
certainty  analysis  since  NCCA  analysts  are 
generally  more  experienced  in  such  analy¬ 
ses.  However,  if  the  program  manager’s 
analyst  performs  the  analysis,  the  NCCA 
analyst  will  be  responsible  for  technical 
guidance  and  assistance. 

In  most  cases,  the  program  manager’s 
analyst  will  be  responsible  for  collecting 
the  programmatic  and  technical  data  re¬ 
quired  as  input  values  to  the  various  cost 
estimating  methodologies.  This  data,  and 
particularly  the  associated  risk  data  de¬ 
fined  above,  must  be  collected  at  the  most 
appropriate  level,  depending  on  the  analy¬ 
sis  being  done,  prior  to  developing  a  cost 
estimate. 

Historically,  technical  and  program¬ 
matic  data  have  been  largely  treated  as 
constants.  For  example,  an  aircraft  may 
be  specified  to  weigh  22,000  pounds 
empty  and  to  carry  exactly  5000  rounds 
of  ammunition.  These  numbers  seldom 
come  out  exactly  as  specified.  The  respon¬ 
sibility  of  the  program  manager’s  analyst 
is  to  obtain  reasonable  bounds  for  these 
values,  which  may  be  used  for  risk  analy¬ 
sis  at  a  later  time. 

Therefore,  whenever  a  value  (e.g., 
quantity,  weight,  length)  is  obtained  for 
future  use  in  a  cost  estimate,  it  must  be 
accompanied  with  a  reasonable  range 
based  on  consultation  with  knowledgeable 
individuals.  Examples  include  “the 
aircraft’s  empty  weight  will  most  likely 
come  in  at  22,000  pounds,  but  may  be  as 
low  as  21,000  pounds  or  as  high  as  25,500 
pounds;”  or  “the  gun’s  magazine  is  ex¬ 
pected  to  carry  between  4800  and  5200 
rounds  of  ammunition  when  fully  loaded.” 

Of  course,  there  will  be  some  values 
that  contain  no  variability.  These  should 
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be  indicated  also.  An  example  might  be 
“the  torpedo  must  be  exactly  24  inches  in 
diameter  since  it  has  to  fit  into  an  existing 
unmodified  launcher.” 

Finally,  in  order  to  do  a  meaningful  risk 
and  uncertainty  analysis,  all  cost  estimates 
that  are  derived  from  lower  level  data  must 
be  documented.  For  example,  if  the  pro¬ 
gram  office  estimates  a  cost  based  on 
empty  weight  and  magazine  capacity,  the 
risk  and  uncertainty  analyst  must  have 
visibility  into  the  values  (and  their  asso¬ 
ciated  ranges)  that  were  used  to  develop 
the  estimate.  In  addition,  the  cost  analyst 
must  document  all  CERs  and  cost  factors 
to  include  statistical  information  such  as 
variance,  standard  deviation,  and  coeffi¬ 
cients  of  variation. 


Procedures 


The  basic  process  required  to  perform 
a  cost  risk  and  uncertainty  analysis  is  first 
to  quantify  each  element  of  the  cost  esti¬ 


mate  in  terms  of  its  statistical  properties 
such  as  mean  or  average,  standard  devia¬ 
tion,  range,  most  likely  cost,  lowest  pos¬ 
sible  cost,  or  highest  possible  cost.  Sec¬ 
ond  is  to  perform  a  Monte  Carlo  simula¬ 
tion.  With  this  technique  one  takes  a  ran¬ 
dom  sample  from  the  probability  distri¬ 
bution  of  each  cost  element.  The  sum  of 
all  randomly  sampled  cost  elements  is  then 
taken  to  be  one  random  sample  of  the  to¬ 
tal  cost.  This  procedure  is  repeated  many 
times.  The  result  of  this  process  is  a  prob¬ 
ability  distribution  about  the  cost  estimate. 
Figure  1  displays  a  representative  risk  and 
uncertainty  analysis  of  average  unit  pro¬ 
duction  phase  costs  from  a  precision- 
guided  munition  program.  This  analysis 
is  the  result  of  10,000  iterations  using  a 
commercial  Monte  Carlo  simulation 
model.  The  mean  cost  is  estimated  at 
$33. IK,  the  standard  deviation  is  $5.7K, 
and  the  range  of  nearly  all  possible  out¬ 
comes  is  from  $15K  to  $50K. 

The  mean,  plus  or  minus  one  standard 
deviation,  may  be  interpreted  as  the  range 
in  which  one  can  be  68  percent  sure  the 


Forecast:  Total  Unit  Cost 

Cell  D22  Frequency  Chart  9,961  Trials  Shown 
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Figure  1.  Example  of  a  Risk  and  Uncertainty  Analysis 
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true  cost  of  the  program  will  occur.  Thus, 
in  this  example,  the  program  manager  can 
be  68  percent  confident  that  the  true  aver¬ 
age  unit  production  phase  cost  for  the 
baseline  program  will  fall  between  $27 .4K 
and  $38. 8K.  Consequently,  there  is  a  16 
percent  chance  that  the  true  cost  will  be 
below  $27.4K  and  a  corresponding  16 
percent  chance  that  the  true  cost  will  be 
higher  than  $38. 8K.  This  information  is 
much  more  useful  to  the  program  man¬ 
ager  than  the  simple  statement  “the  aver¬ 
age  unit  production  phase  cost  is  estimated 
at  $33. IK.” 

An  Example  Risk  and  Uncertainty 
Analysis 


The  following  example  of  a  risk  and 
uncertainty  analysis  is  intended  to  solidify 
the  concepts  discussed  previously.  In  this 
example,  a  risk  and  uncertainty  analysis 
will  be  performed  on  each  individual  work 
breakdown  structure  element  using  a 
Monte  Carlo  simulation.  Additionally,  an 
overall  risk  and  uncertainty  analysis  will 
be  conducted  on  the  rolled  up  estimate 
using  the  same  methodology. 

Suppose  you  are  asked  to  perform  a  risk 
and  uncertainty  analysis  on  a  missile  guid¬ 
ance  and  control  (G&C)  unit  cost  estimate 
(for  expediency,  learning  curve  phenom¬ 
ena  will  be  temporarily  ignored).  The 
work  breakdown  structure  for  the  G&C 
consists  of  a  seeker  and  a  processor. 


Seeker  Risk  and  Uncertainty  Analysis 

The  program  manager’s  cost  analyst 
discussed  the  properties  of  the  seeker  with 
the  engineer  responsible  for  its  design.  The 
cost  analyst  has  found  a  CER  to  estimate 
the  unit  cost  of  the  seeker,  which  has  op¬ 
erating  frequency  as  its  input  variable.  The 
CER  is  shown  below. 


Seeker  cost  (FY  96  $K)  =  0.41  x  (Freq.  in  khz)078 
Standard  error  =  0.17  (+18.5%  -1  5.6%) 


According  to  the  engineer,  there  is  an 
80  percent  chance  that  the  seeker  will  op¬ 
erate  at  120  khz,  but,  due  to  design  con¬ 
straints,  there  is  a  corresponding  20  per¬ 
cent  chance  that  it  will  operate  at  80  khz. 
The  risk  associated  with  the  seeker  cost  is 
a  function  of  the  choice  of  operating  fre¬ 
quency  (120  khz  or  80  khz).  The  uncer¬ 
tainty  is  tied  to  the  CER  (+1 8.5%,  -15.6%). 
This  situation  can  be  modeled  as  seen  in 
Figure  2,  where  risk  is  modeled  using  a 
discrete  probability  distribution  and  un¬ 
certainty  is  modeled  using  a  log  normal 
probability  distribution. 

Based  on  a  Monte  Carlo  simulation 
with  10,000  iterations,  the  mean  unit  cost 
estimate  is  $16.27K  with  a  standard  de¬ 
viation  of  $3.37K1.1  Therefore,  we  see  a 
68  percent  chance  that  the  true  cost  of  the 
seeker  will  fall  within  the  mean  plus  or 
minus  one  standard  deviation  ($12.90K  to 
$19.64K)  while  the  range  of  nearly  all 
possible  costs  varies  from  approximately 
$7.50K  to  $27.50K. 


1  The  mean  and  standard  deviation  reported  here  are  actually  the  sample  mean  and  sample  standard  deviation 
of  the  10,000  data  points  resulting  from  the  simulation.  They  are  calculated  as  if  the  data  were  drawn  from  a 
normal  probability  distribution.  As  long  as  the  resulting  data  set  has  a  normal  appearance  (i.e.,  a  bell-shaped 
curve),  then  the  reported  mean  and  standard  deviation  provide  reasonable  approximations  of  the  true  mean 
and  standard  deviation. 
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Forecast:  Seeker  Unit  Cost 

Cell  Dll  Frequency  Chart  9,983  Trials  Shown 


Figure  2.  Seeker  Risk  and  Uncertainty  Analysis 


In  the  absence  of  a  risk  and  uncertainty 
analysis,  the  cost  analyst  might  choose  to 
estimate  this  cost  element  by  calculating 
the  seeker  cost  CER  using  a  weighted  av¬ 
erage  frequency. 


(120  khz)  x  (0.8)  +  (80  khz)  x  (0.2)  =  112  khz 
Seeker  cost  =  0.41  x  ( 112  khz)078  =  $  16.26K 


Notice  that  the  point  estimate  is  nearly 
identical  to  the  mean  cost  calculated  us¬ 
ing  the  Monte  Carlo  simulation.  However, 
the  risk  and  uncertainty  analysis  provides 
significantly  more  information  to  the  pro¬ 
gram  manager. 

Processor  Risk  and  Uncertainty  Analysis 

The  program  manager’s  cost  analyst 
also  discussed  the  properties  of  the  pro¬ 
cessor  with  the  engineer  responsible  for 
its  design.  According  to  the  engineer,  the 
processor  is  highly  specialized  and  there 
are  no  analogous  systems  to  be  found. 
However,  the  analyst  has  found  a  CER  that 
relates  the  unit  cost  of  a  processor  to  the 


number  of  zener  diodes  contained  in  the 
processor.  The  engineer  has  estimated  the 
possible  number  of  zener  diodes  inside  the 
processor  with  a  triangular  distribution. 
According  to  the  engineer,  the  minimum 
number  of  zener  diodes  is  10,  the  abso¬ 
lute  maximum  number  is  30,  and  the  most 
likely  number  is  15.  The  processor  unit 
cost  CER  is  as  follows. 


Processor  unit  cost  (FY  96  $K)  =  5.3  +  0.63 
x  (Number  of  zener  diodes] 
Coefficient  of  variation  =  22% 


The  risk  associated  with  the  processor 
is  a  function  of  the  number  of  zener  di¬ 
odes  required.  The  uncertainty  is  mani¬ 
fested  in  the  coefficient  of  variation  in  the 
processor  unit  cost  CER.  This  situation  is 
modeled  using  a  triangular  distribution  for 
the  number  of  zener  diodes  and  a  normal 
distribution  for  the  cost  CER,  as  shown  in 
Figure  3. 

Based  on  a  Monte  Carlo  simulation 
with  10,000  iterations,  the  mean  unit  cost 
estimate  is  $16.83K  with  a  standard  de- 
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Figure  3.  Processor  Risk  and  Uncertainty  Analysis 


viation  of  $4.64K.  Therefore,  we  see  a  68 
percent  chance  that  the  true  cost  of  the 
processor  will  fall  within  The  mean  plus 
or  minus  one  standard  deviation  ($12.19K 
to  $21.47K),  while  the  range  of  nearly  all 
possible  costs  is  approximately  $2.50K  to 
$30.00K. 

Again,  in  the  absence  of  a  risk  and  un¬ 
certainty  analysis,  the  cost  analyst  might 
choose  to  estimate  this  cost  element  by 
calculating  the  processor  CER  using  the 
most  likely  number  of  zener  diodes,  which 
was  stated  earlier  as  15. 


Processor  cost  *  5.3  +  0.63  x  ( 15)  -  $  14.75K 


Notice  that  in  this  case,  the  point  esti¬ 
mate  is  quite  a  bit  less  than  the  mean  cost 
calculated  using  the  Monte  Carlo  simula¬ 
tion.  This  difference  is  primarily  due  to 
the  risk  associated  with  the  wide  range  in 
the  possible  number  of  zener  diodes. 


Total  Guidance  &  Control  Risk  and 
Uncertainty  Analysis 

The  total  unit  cost  for  the  guidance  and 
control  is  the  sum  of  the  cost  estimates 
for  both  the  seeker  and  the  processor. 
However,  since  we  are  no  longer  dealing 
in  just  point  estimates,  it  is  appropriate  to 
run  one  more  Monte  Carlo  simulation, 
where,  on  each  iteration,  the  random  ob¬ 
servations  for  the  seeker  and  processor  are 
summed  and  the  result  is  the  random  ob¬ 
servation  for  the  total  unit  cost.  Figure  4 
shows  the  results  of  this  exercise. 

Based  on  a  Monte  Carlo  simulation 
with  10,000  iterations,  the  mean  total  unit 
cost  is  $33.10K.  Note  that  this  number  is 
simply  the  sum  of  the  mean  costs  for  the 
seeker  ($16.27K)  and  the  processor 
($16.83K),  as  one  would  expect.  The  stan¬ 
dard  deviation  for  this  cost  distribution, 
however,  is  $5.71K,  which  is  less  than  the 
sum  of  the  standard  deviations  for  the 
seeker  and  processor.  These  phenomena 
are  consistent  with  statistical  theory. 

The  smaller  standard  deviation  leads  to 
an  interesting  result.  When  summed  to- 
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Forecast:  Total  Unit  Cost 

Cell  D22  Frequency  Chart  9,961  Trials  Shown 
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Figure  4.  Total  6&C  Risk  and  Uncertainty  Analysis 


gether,  the  total  unit  cost  estimate  has  a 
tighter  range  than  if  one  had  simply 
summed  the  endpoints  of  the  two  sub¬ 
elements.  For  example,  the  lowest  ob¬ 
served  cost  for  the  seeker  was  $7.50K, 
while  the  lowest  observed  cost  for  the  pro¬ 
cessor  was  $2.50K.  Summed  together,  one 
might  expect  the  lowest  observed  total  cost 
to  be  $10.00K.  However,  since  summing 
the  two  sub-elements  has  reduced  the 
overall  variance,  we  find  in  the  simula¬ 
tion  that  the  lowest  observed  total  unit  cost 
is  actually  $15.00K.  A  similar  result  oc¬ 
curs  with  the  highest  observed  costs.  In¬ 
stead  of  the  summed  value  of  $57.50K, 
the  simulation  shows  that  the  highest  ob¬ 
served  cost  of  the  sum  is  actually  only 
$50.00K.  Thus,  the  more  we  aggregate  the 
cost  elements,  the  more  precise  our  cost 
estimates  using  this  methodology. 

Therefore,  for  the  total  G&C,  we  have 
a  68  percent  chance  that  the  true  cost  will 
fall  within  the  mean  plus  or  minus  one 
standard  deviation  ($27.39K  to  $38.81K) 


while  the  range  of  nearly  all  possible  costs 
varies  from  $15.00K  to  $50.00K. 


Summary 


This  primer  illustrates  the  benefits 
available  to  program  managers  and  mile¬ 
stone  decision  authorities  when  a  proper 
risk  and  uncertainty  analysis  is  performed 
on  a  baseline  cost  estimate.  What  the 
reader  should  gain  from  this  article  is  an 
appreciation  of  the  superiority,  from  a  de¬ 
cision-maker’s  perspective,  of  a  point  es¬ 
timate  with  a  risk  and  uncertainty  analy¬ 
sis,  as  opposed  to  a  point  estimate  alone. 
The  reader  should  also  understand  the  in¬ 
creased  responsibility  of  the  cost  estimat¬ 
ing  analyst  with  respect  to  data  collection, 
in  that  all  data  used  in  creating  a  cost  esti¬ 
mate  must  include  range  or  variability  as¬ 
sessments. 
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ACQUISITION  OF  STATE-OF-THE-ART 
LOGISTICS  COMBAT  SUPPORT  SYSTEMS: 
THE  JOINT  LOGISTICS  ADVANCED 
CONCEPT  TECHNOLOGY 
DEMONSTRATION  PROGRAM 

JUan  C.  Barrkk  and  Henry  C.  Alberts 


The  past  few  years  have  seen  major  changes  in  the  policies  used  to  acquire 
weapon  systems.  Change  has  come  from  three  sources.  One  is  congressional 
actions  (passage  of  Pub.  L.  103-355,  the  Federal  Acquisition  Streamlining  Act 
of  1994,  and  subsequent  language  in  authorization  and  appropriation  bills  for 
fiscal  years  1995  and  1996).  Another  is  Department  of  Defense  (DoD)  policy 
changes  (such  as  DoD’s  Commercial  and  Non-Developmental  Items  [CAND1] 
and  Open  Architecture  initiatives),  and  the  third  is  publication  of  the  “Joint 
Logistics  Commanders’  Guidance  on  the  Use  of  Evolutionary  Acquisition 
Strategy.”  Here  we  describe  how  these  changes  in  acquisition  philosophy  have 
been  applied  to  rapidly  develop,  field,  and  operate  a  combat  logistic  support 
system  that  has  successfully  supported  joint  activities  within  three  major 
commands. 

This  article  is  written  with  the  expectation  that  lessons  learned  during  Phase  I 
of  the  Joint  Logistics  Advanced  Concept  Technology  Demonstration  (JL-ACTD) 
can  help  others  involved  in  programs  to  incorporate  newly  available  technology 
into  the  equipment  provided  to  our  combat  forces. 


In  today’s  global  environment,  our 
military  forces  are  employed  in  joint 
and  multinational  operations.  Improv¬ 
ing  their  ability  to  operate  in  those  modes 
must  be  a  major  DoD  objective.  The  Joint 
Logistics  Advanced  Concept  Technology 


Demonstration  (JL-ACTD),  an  Office  of  the 
Secretary  of  Defense-sponsored  acquisition 
demonstration,  was  initiated  to  provide  a 
logistics  decision  support  tool  for  theater 
commanders-in-chief  (CINCs)  and  com¬ 
bined  joint  task  force  (CJTF)  commanders. 
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At  the  operational  and  tactical  level,  the 
focus  of  Service  logistics  will  shift  from 
“supporting  units  and  areas”  to  “project¬ 
ing  and  sustaining  force  capability.”  Spe¬ 
cifically,  logisticians  will  concentrate  on 
the  consolidation  of  management  activi¬ 
ties  and  eliminate  the  myriad  of  stovepipe 
functions  (e.g.,  supply,  maintenance,  and 
transportation).  Having  appropriate  com¬ 
munications  will  make  it  possible  to  see 
available  total  assets  and  have  complete 
in-transit  information.  These  attributes 
will  consolidate  into  a  reliable,  disciplined, 
and  responsive  system  that  provides 
weapon  system  sustainment  to  combined 
forces. 

In  the  “combined  operations”  future, 
logisticians  will  have  to  work  through  a 
fog  of  varied,  unknown,  and  unpredictable 
threat  scenarios.  Therefore,  the  new  logis¬ 
tics  activity  must  have  training  modules 


that  simulate  force  equipment  projection, 
equipment  utilization  rates,  and  force  con¬ 
sumption  rates  of  classes  of  supplies.  This 
will  permit  planners  to  “see”  the  effects 
of  their  decisions  on  expected  force  and 
weapon  system  sustainability.  Incorporat¬ 
ing  such  modules  will  also  enable  logisti¬ 
cians  to:  (a)  consider  issues  of  ad  hoc  sup¬ 
port  to  coalitions;  (b)  evaluate  alternative 
mechanisms  for  tailoring  capacity  based 
logistics;  (c)  assess  the  potential  for  im¬ 
proving  bare  base  operations;  (d)  analyze 
increased  use  of  civilian  and  host  nation 
support  assets;  and,  (e)  conduct  tradeoff 
analyses  of  plans  for  deployment  (either 
before,  or  concurrently  with  combat 
forces). 

Warfighters  provided  the  definition  of 
an  appropriate  end  product  requirement. 
They  modeled  and  analyzed  logistics  pro¬ 
cesses  from  a  joint  perspective,  deter- 
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mined  opportunities  to  improve  that  pro¬ 
cess,  and  identified  the  characteristics  of 
systems  most  capable  of  providing  for 
those  needs.  This  process  defined  the  pro¬ 
gram  objective:  Give  CINCs  and  CJTFs 
the  capability  to  plan  and  execute  more 
responsive  and  efficient  logistics  support. 
Phase  I  of  the  JL-ACTD  satisfied  this  goal 
by  providing  warfighters  with  integrated, 
accurate  pictures  of  pertinent  battle  space 
from  a  joint  perspective  in  real  time.  Do¬ 
ing  this  required  real-time  integration  of 
a  tremendous  amount  of  information  pre¬ 
sented  in  many  different  formats. 

It  was  envisioned  that  the  JL-ACTD 
would  provide  battlefield  awareness  nec¬ 
essary  to  permit  all  combat  leadership  to 
see  the  same  battlefield,  and  to  share  the 
information  required  to  permit  joint  deci¬ 
sion  making.  That  is,  the  JL-ACTD  would 
provide  the  right  information,  at  the  right 
time,  in  the  right  place  and  in  the  proper 
integrated  configuration  for  immediate  use 
by  decision  makers. 

But  the  needs  of  joint  level  Combat 
Service  Support  (CSS)  planners  for  deci¬ 
sion  support  systems  vary  significantly 
from  echelon  to  echelon  and  from  organi¬ 
zation  to  organization.  CSS  planners  at  all 
echelons  seek  validated,  integrated,  high- 
quality  automated  systems  to  support  their 
decision-making  analyses.  At  the  begin¬ 
ning  of  this  program,  direct  access  to  rel¬ 
evant  data  was  lacking,  and  interoperable 
mechanisms  for  summarizing  and  present¬ 
ing  data  were  virtually  nonexistent.  This 
lack  of  interactive  connectivity  and  high- 
level  interoperability  created  a  myopic 
view  of  the  situation,  which  resulted  in 
lower  quality  plans  and  inefficient  use  of 
resources.  Logisticians  needed  real-time 
information  to  be  effective.  Precise  infor¬ 


mation  is  needed  to  achieve  precision  lo¬ 
gistics. 


An  Approach  to  Meeting  the 
Changing  Logistics  Requirements 


Existing  technology  permits  collection 
and  distribution  of  tremendous  amounts 
of  information  in  near  real  time.  Service 


:omponents  in  each  unified  and  specified 


combatant  com- 1 

mand  have  lo-  m  .  , 

stics  inven -  le*h"0,#9y 

gistics  inven  permits  co||ecfion 

tory  and  ac -  amj  distribution  of 

countability  |remein|ous  amounts 

systems  that  re-  of  information  in 

port  upwards  j  „onr  real  time." 

from  the  tactical 

level  to  the  na-  <• 

tional  level  through  a  hierarchical  net¬ 
work.  But  even  though  such  systems  ex¬ 
ist  within  the  services  and  defense  agen¬ 
cies,  they  are  “stovepiped”  within  the 
service’s  own  logistics  communities.  As 


a  result,  these  systems  do  not  integrate 
those  aspects  of  supply,  maintenance,  and 
transportation  essential  for  making 
tradeoff  decisions  during  planning  and 
execution  of  contingency  operations. 

The  former  Under  Secretary  of  Defense 


for  Acquisition  and  Technology,  Dr.  Paul 
Kaminski,  initiated  the  JL-ACTD  program 
to  develop  a  modem  “precision  logistics 
unified  support”  system  for  CINC  and 
CJTF  warfighters.  In  it,  the  amount  and 
type  of  logistics  information  needed  to  sat¬ 
isfy  warfighters’  needs  could  be  accessed, 
analyzed,  and  exchanged  as  needed,  us¬ 
ing  a  “common  operating  environment.” 
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An  ACTD  applies  maturing  advanced 
technologies  in  real-time  operational  sce¬ 
narios  to  establish  real-world  practicabil¬ 
ity  and  operational  utility.  A  successful 
ACTD  will,  upon  conclusion,  leave  be¬ 
hind  an  in-place,  resident  operational  ca¬ 
pability  that  can  be  tailored,  replicated,  or 

transitioned 

"From  the  outset,  into  an  aPPro‘ 

the  JL-ACTD  was  Priate  Point  of 

established  te  per-  the  formal  ac- 

mit  adoption  of  a  quisition  cycle. 

more  efficient  ap-  From  the  outset, 

preach  to  the  acqul-  the  JL-ACTD 

sition  process."  was  established 

to  permit  adop¬ 
tion  of  a  more  efficient  approach  to  the 
acquisition  process.  As  it  has  been  pur¬ 
sued,  the  program  has  used  the  evolution¬ 
ary  acquisition  (EA)  methodology  de¬ 
scribed  in  the  Joint  Logistics  Command¬ 
ers  Guidance.  The  EA  process  has  fostered 
rapid  transition  of  emerging  technology 
into  a  system  that  gives  warfighters  the 
ability  to  simultaneously  develop  appro¬ 
priate  doctrine  and  concepts  of  operation. 

The  JL-ACTD  Program 


Overview 

The  JL-ACTD  goal  is  to  provide  the 
warfighting  CINCs  and  joint  task  force 
commanders  with  a  robust  capability  to 
plan,  execute,  and  monitor  logistics  op¬ 
erations. 

The  basic  functional  element  of  Phase 
I  of  the  JL-ACTD  is  the  Logistics  Anchor 
Desk  (LAD).  The  LAD  concept  was  origi¬ 
nally  created  by  the  U.S.  Army  Materiel 
Command  and  the  Software  and  Intelli¬ 
gent  Systems  Technology  Office  of  the 
Defense  Advanced  Research  Projects 


Agency  (DARPA).  The  LAD  (worksta¬ 
tion)  consolidates  data  from  multiple 
sources,  such  as  Automated  Identification 
Technology,  to  provide  situation  aware¬ 
ness  of  current  operations  for  the  user.  The 
initial  “prototype”  LAD  leveraged  exist¬ 
ing  components  from  the  Army  Research 
Laboratory’s  Knowledge-Based  Logistics 
Planning  Shell,  the  Transportation 
Command’s  (TRANSCOM)  Analysis  of 
Mobility  Platform,  and  the  Joint  Total 
Asset  Visibility  (JTAV)  program,  for  its 
initial  capability  to  analyze  current  and 
future  logistics  operations.  The  LAD  le¬ 
verages  the  Army  Research  Laboratories’ 
experience  in  logistics  analysis  and  plan¬ 
ning  tools.  This  shared  view  of  the  battle¬ 
field  is  fed  into  models  and  simulations 
to  support  the  development,  evaluation, 
and  analysis  of  courses  of  action.  Through 
the  use  of  collaborative  planning  and 
course  of  action  analysis  programs,  the 
commander  can  “see”  the  unfolding  lo¬ 
gistical  needs  for  strategic,  operational, 
and  tactical  consideration. 

The  program  was  structured  to  have  a 
two-year  development  phase  followed  by 
a  user  operational  evaluation  period.  The 
prototype  LAD  concept  was  initiated  by 
the  Army  Materiel  Command  in  Febru¬ 
ary  1994  as  part  of  the  Louisiana  Maneu¬ 
vers  Program  and  was  incorporated  within 
the  Army’s  Total  Distribution  Advanced 
Technology  Demonstration  (TDATD)  in 
January  1995.  After  successful  participa¬ 
tion  in  Army  and  Joint  exercises,  and  af¬ 
ter  briefing  the  Joint  Logistics  Command¬ 
ers  in  January  1995,  the  program  was  es¬ 
tablished  as  a  new  ACTD  on  Oct.  1 , 1 995. 
(The  success  of  the  LAD  led  to  its  incor¬ 
poration  into  the  Army’s  TDATD  in  Feb¬ 
ruary  1995). 
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The  LAD  hardware  and  software  con¬ 
figuration  forms  a  system  to  function  as  a 
Logistic  Decision  Support  Tool  for  CINCs 
and  CJTF  commanders.  The  program  pro¬ 
vided  for  phased  installation  and  opera¬ 
tion  of  21  LADs  at  three  separate  CINCs 
over  a  two-year  period.  The  CINCs  an¬ 
nual  exercises  would  provide  a  means  for 
evaluating  the  LAD  capabilities,  defining 
and  refining  CEMC  operational  needs,  and 
facilitating  the  process  for  including  LAD 
refinements  in  the  fielded  system.  Figure  1 


shows  the  elements  of  the  LAD  and  how 
they  are  integrated  to  meet  commanders’ 
needs. 

JL-ACTD  Capabilities  Evolution 
Under  JOLT 

The  Joint  Office  for  Logistics  Technol¬ 
ogy  (JOLT)  was  established  in  March 
1997.  The  new  organization  is  led  by 
DARPA  in  close  coordination  with  the 
Defense  Information  Systems  Agency 
(DISA)  and  the  Joint  Staff  Director  of 


The  Logistics  Anchor  Desk  Includes: 


The  LAD  LETS  Commanders: 


•  See  the  same  battlefield 

•  Share  information 

•  Make  joint  coordinated  decisions 


ACRONYMS 

JTAV 

Joint  Total  Asset  Visibility 

DSI 

Defense  Simulation  Internet 

■CIS 

Integrated  Consumable  Item  Support 

SIPRNET 

Secret  Internet  Protocol  Router  Network 

TRANSCOM 

Transportation  Command 

AMP 

Analysis  of  Mobility  Platform 

GBS 

Global  Broadcast  System 

KBLPS 

Knowledge  Based  Logistics  Planning  Shell 

Figure  1*  The  JL-ACTD  Logistics  Anchor  Desk 
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Logistics  (J4).  JOLT  is  responsible  for  the 
JL-ACTD.  This  includes  transitioning 
Phase  I  (LAD)  functionality  to  Phase  II 
(Joint  Decision  Support  Tools,  or  JDST) 
and  to  Phase  III  (Real-Time  Focused  Lo¬ 
gistics).  This  action  has  four  objectives. 
First  is  expanding  the  successes  of  the  JL- 

ACTD  Phase  I 
and  developing 
"These  [support]  decision  sup- 

tools  will  support  port  t00is  t0 

logistics  operations  support  all  of 

across  the  entire  the  services, 

operational  spec-  , 

tram— mobilization,  a"  . 

deployment,  CINCs- Second 

employment,  is  strengthening 

sustainment,  and  linkage  be- 

redeployment/7  tween  DARPA 

logistics  tech¬ 
nology  initia¬ 
tives  and  their  logistics  customers,  and 
third  is  ensuring  that  JL-ACTD  software 
tools  can  “plug  and  play”  within  the  Glo¬ 
bal  Combat  Support  System  (GCSS) 
Internet  environment.  The  fourth  objec¬ 
tive  is  continuing  to  provide  “LAD  func¬ 
tionality”  to  CINCs  Central  Command 
(CENTCOM),  the  Atlantic  Command 
(ACOM),  and  the  European  Command 
(EUCOM).  Phase  I  is  currently  transi¬ 
tioning  products  to  the  DISA  GCSS. 

The  JL-ACTD  Phase  I  (LAD),  which 
was  highly  successful,  ended  in  April 
1997.  During  fiscal  year  1997-98,  the  JL- 
ACTD  Phase  II  (JDST)  will  develop  spe¬ 
cific  joint,  integrated  decision  support 
tools  to  provide  CINC,  CJTF,  and  service 
and  agency  planners  the  capability  to  plan 
or  replan  logistics  operations  based  on  ac¬ 
tual  asset  visibility  and  control.  These 
tools  will  support  logistics  operations 
across  the  entire  operational  spectrum — 
mobilization,  deployment,  employment, 


sustainment,  and  redeployment.  They  will 
conform  to  all  Defense  Information  Infra¬ 
structure  (DII)  standards  and  be  accessible 
through  GCSS.  They  will  access  data 
through  the  Joint  Total  Asset  Visibility 
(JTAV),  Joint  Personnel  Asset  Visibility 
(JPAV),  Global  Transportation  Network 
(GTN),  Joint  Operational  Planning  and 
Execution  System  (JOPES),  or  other  ex¬ 
isting  or  developing  architectures.  People, 
units,  equipment,  and  supplies  will  be  in¬ 
cluded.  These  solutions  will  be  linked  with 
other  functional  area  initiatives  such  as  the 
Advanced  Joint  Planning  ACTD  and  the 
Battlefield  Awareness  and  Data  Dissemi¬ 
nation  ACTD.  Specific  objectives  are  to: 

•  provide  a  single,  near-real-time,  glo¬ 
bally  available  view  of  operational  lo¬ 
gistics  data  from  strategic  to  tactical 
level; 

•  improve  operational  awareness,  col¬ 
laborative  logistics  planning,  monitor¬ 
ing,  and  analysis  tools; 

•  provide  tools  to  enable  course  of  ac¬ 
tion  assessment,  execution  monitoring, 
and  dynamic  replanning  within  the  de¬ 
cision  cycle  window; 

•  build  on  existing  decision  support  tools 
where  applicable,  and  identify  and  de¬ 
velop  new  tools  where  none  exist;  and 

•  demonstrate  initial  data  interoperability 
through  a  shared  data  environment  in 
coordination  with  GCSS  efforts. 

During  fiscal  year  1999-2001,  JL- 
ACTD  Phase  III  (Real-Time  Focused  Lo¬ 
gistics)  will  provide  a  seamless  informa¬ 
tion  and  decision  support  capability 
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among  combat  service  support  and  opera¬ 
tions  functions  to  support  the  warfighter. 
This  information  will  be  available  on  any 
workstation  (hardware  independent)  and 
on  one  net  (the  Defense  Information  In¬ 
frastructure  [DII]  common  operating  en¬ 
vironment  [COE]),  and  will  present  one 
fused  picture  of  the  expanded  battle  space. 
Specific  objectives  are  to: 

•  provide  operational  commanders  in¬ 
creased  combat  power  through  greater 
control  of  the  logistics  pipeline; 

•  develop  and  demonstrate  a  complete, 
end-to-end,  advanced  logistics  system 
for  the  planning,  executing,  monitor¬ 
ing,  and  rapid  replanning  of  a  major 
force  deployment  from  the  continental 
United  States  (CONUS)  to  in-theater 
final  destination  and  return  to  CONUS 
origins; 

•  develop  and  demonstrate  fine-grained 
course  of  action  evaluation  with  access 
to  supporting  information  and  analy¬ 
ses  linked  to  all  other  segments  of  the 
war  plan; 

•  demonstrate  total  integrated  logistics 
infrastructure  requirements  for  dy¬ 
namic  replanning;  and 

•  demonstrate  collaborative  J3  and  J4 
interoperability  via  integrated  opera¬ 
tions  COE  workstations  to  support 
planning  and  execution  monitoring. 

Participants 

The  Operational  Users  are:  (a)  the  Com¬ 
mander  in  Chief,  European  Command;  (b) 
the  Commander  in  Chief,  Atlantic  Com¬ 
mand;  (c)  the  Commander  in  Chief,  Cen¬ 


tral  Command;  (d)  the  warfighting  CJTF 
elements  within  the  Commands;  (e)  the 
Joint  Staff;  and  (f),  functional  support 
from  the  U.S.  Transportation  Command 
and  the  Defense  Logistics  Agency  (DLA). 
LADs  are  currently  at  U.S.  Air  Force-Eu- 
rope  (Ramstein  AFB)  and  U.S.  Marine 
Corps  Bases  (Camps  Pendleton  and 
Lejeune).  EUCOM  continues  to  use  LAD 
capability  in  support  of  Operation  Joint 
Endeavor  and  Joint  Guard.  Both  ACOM 


and  CENTCOM  have  LADs  within  their 
organizations. 


D  ARPA  and  the 
service  labora- 1 
tories  are  pro¬ 
viding  technol¬ 
ogy.  Twenty- 
one  LAD  units 
have  been  in-  ? 
stalled  and  are 
now  operational 
in  Europe  and 
in  the  CONUS. 


"The  JL-ACTD  focuses 
on  improvements  to 
situational  aware¬ 
ness,  distributed 
collaboration  capa¬ 
bilities,  and  tools  fcif 
logistics  planning, 
monitoring,  and 
analysis/' 


The  LAD  operating  in  Bosnia  to  support 
U.S.  and  Allied  Force  involvement  there 
has  been  of  special  interest.  This  unit  has 
been  praised  by  the  operational  units  and 
the  CINC  for  the  new  capabilities  it  has 
provided. 


Residual  Capability 

The  JL-ACTD  focuses  on  improve¬ 
ments  to  situational  awareness,  distributed 
collaboration  capabilities,  and  tools  for 
logistics  planning,  monitoring,  and  analy¬ 
sis.  To  this  end,  it  will  leave  a  network  of 
workstations,  interfaces  to  exercise  and 
operational  data,  and  communications 
within  the  CINCs  operations  and  logistics 
planning  cells.  These  residual  capabilities 
will  use  data  from  the  JTAV  program, 
complement  the  operational  planning  ca- 
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pabilities  provided  by  the  Advanced  Joint 
Planning  ACTD,  use  the  Battlefield 
Awareness  and  Data  Dissemination  ACTD 
telecommunications  capabilities,  and  in¬ 
tegrate  into  the  emerging  GCSS. 

Most  important,  the  LAD  will  be  able 
to  easily  incorporate  future  technology 
advances  that  will  give  the  CINCs  the  ben¬ 
efit  of  continuous  system  improvement  to 
match  change  to  their  particular  opera¬ 
tional  requirements.  This  advantage  is  a 
direct  result  of  the  way  the  system  was 
designed  using  the  evolutionary  acquisi¬ 
tion  process. 

Thi  Jl-ACTD  Acquisition  Strategy 

Streamlined  acquisition  and  manage¬ 
ment  processes  have  been  used  through 
out  the  JL-ACTD  process,  resulting  in  the 
choice  of  an  evolutionary  acquisition  strat¬ 
egy  as  described  in  the  “Joint  Logistics 
Commanders  Guidance  for  the  Use  of 
Evolutionary  Acquisition  Strategy  to  Ac¬ 
quire  Weapon  Systems.”  The  JL-ACTD 
management  concepts  have  been  tailored 
in  accordance  with  DoD  Instruction 
5000.2-R.  Phases  I,  II,  and  III  of  the  strat¬ 
egy,  as  mentioned  previously,  maintain  the 
underlying  principles  of  an  ACTD:  Pro¬ 
totype  Development  and  Distribution; 
Joint  Technology  Applications;  and  User 
Assessment  and  Evaluation. 

•  Phase  I.  LAD  was  essentially  limited 
operational  use  of  the  core  LAD  pro¬ 
totype  capability.  The  JL-ACTD  LAD 
prototype  was  dynamically  configured 
from  existing  models,  simulations,  and 
tech  base  demonstration  components 
using  advanced  knowledge-based  sys¬ 
tems  engineering  technologies.  Inter¬ 


faces  could  be  tailored  to  specific  user 
requirements  to  support  user-specific 
tasks. 

•  Phase  II.  Joint  Decision  Support  Tools 
is  the  formal  assessment  and  incorpo¬ 
ration  of  other  laboratory  and  service 
initiatives,  ACTDs,  etc.,  that  will  en¬ 
hance  or  increase  the  LAD  prototype 
capabilities. 

•  Phase  III.  Real-Time  Focused  Logis¬ 
tics  is  the  major  objective  of  a  seam¬ 
less  information  and  decision  support 
capability,  to  be  available  on  any  work¬ 
station  and  DII-  and  COE-compliant. 
Upon  conclusion,  the  success  of  the 
ACTD  will  be  the  transition  to  GCSS 
and  into  the  appropriate  point  of  the 
formal  acquisition  cycle. 

The  phases  are  not  mutually  exclusive: 
succeeding  phases  build  on  the  results  of 
previous  phases  and  use  the  assets  pro¬ 
vided  in  that  phase.  Demonstration  exer¬ 
cises  have  been  used  to  provide  a  cost- 
effective  basis  for  operational  users  to 
make  informed  acquisition  decisions  when 
required.  In  addition,  management  of  the 
JL-ACTD  will  be  monitored  by  a  Transi¬ 
tion  Integrated  Product  Team,  including 
representation  from  the  principal  co-spon- 
soring  users,  development  organizations, 
and  the  Joint  Staff. 

Present  Status  and  Plans 


Past  and  Current  Efforts 

The  efficiency  and  streamlining  provi¬ 
sions  obtained  by  selection  of  an  evolu¬ 
tionary  acquisition  strategy  permitted 
rapid  progress  through  the  first  phase. 
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Significant  achievements  include  the  fol¬ 
lowing. 

October  1995.  The  JL-ACTD  began 
supporting  EUCOM  Planning  Cells  for 
Operation  Joint  Endeavor.  Currently,  The 
JL-ACTD  maintains  five  LAD  sites  in  the 
European  Theater,  including  one  with  U.S. 
forces  in  Bosnia-Herzegovina.  EUCOM 
support  resulted  in  requests  for  two  addi¬ 
tional  CONUS  sites;  the  Army  Materiel 
Command  Logistics  Operations  Center 
and  the  Joint  Chiefs  of  Staff  (JCS/J4). 
Although  the  EUCOM  CINC  was  not  part 
of  the  initial  ACTD,  its  real-world  mis¬ 
sion  provided  a  significant  test  bed  for 
LAD  development  and  enhancement. 

February  1996.  The  JL-ACTD  Pro¬ 
gram  Office  tasked  RAND  to  conduct  a 
study  to  determine  how  distributed  col¬ 
laborative  planning  and  execution  in 
Headquarters,  EUCOM  and  US  Army 
Europe  (USAREUR),  was  being  sup¬ 
ported  with  capabilities  provided  by  the 
LAD  and  related  Total  Asset  Visibility 
(TAV)  tools  and  processes.  The  JL-ACTD 
Office  supports  these  organizations  in 
contingency  planning  for  logistics  opera¬ 
tions  in  Bosnia  and  surrounding  regions. 
The  RAND  analysis  and  evaluation  of  op¬ 
erational  support  stated  that  the  LAD 
accomplished  the  following. 

•  It  offered  many  information  logistics 
capabilities  on  a  single  platform — 
movement,  supply,  maintenance,  and 
engineering — and  it  provided  efficient, 
deployable  logistics  information  and 
automation. 

•  It  provided  useful  planning  and  impor¬ 
tant  second  views  for  logistics  planners 
and  commanders. 


•  It  was  widely  recognized  as  an  impor¬ 
tant  saver  of  staff  time:  it  did  real  work 
faster,  reduced  staff  coordination  de¬ 
mands  and  busywork,  and  sped  dis¬ 
semination  of  authoritative  informa¬ 
tion. 

•  It  provided  access  to  otherwise  unavail¬ 
able  information  (such  as  detailed,  on¬ 
line  National  Imagery  and  Mapping 
Agency  maps,  and  status  of  key  assets). 

•  LAD  video-teleconferencing  contacts 
are  confidence-builders. 

September  1996.  The  JL-ACTD  Phase 
I  (LAD)  Project  Office  provided  its  year- 
end  report  to  the  Office  of  the  Secretary 
of  Defense  leadership  and  described  its  fu¬ 
ture  planning  for  integrating  its  functions 
into  the  Global  Command  and  Control 
System  (GCCS).  The  Integration  “In  Pro¬ 
cess  Review,”  also  held  during  this  period, 
provided  a  clear  statement  of  activities 
planned  for  fiscal  year  1997. 


Future  Activities  and  Transition  to  an 
Established  Program 

The  initial  phase  of  the  JL-ACTD  has 
achieved  its  major  objectives.  It  has  suc¬ 
cessfully  demonstrated  the  viability  and 
battlefield  util¬ 
ity  of  Joint  De- f 
cision  Support  | 

Tools,  the  LAD 
concept,  and  the  J 
ability  of  cur-  f 
rent  technology 

to  provide  for  expanding  functional  logis¬ 
tic  support  capacity.  The  next  major  pri¬ 
ority  is  to  incorporate  this  demonstrated 
capability  with  an  established  program 
office  while  providing  for  ongoing  sup- 


"The  initial  phase  of 
the  JL-ACTD  has 
achieved  its  major 
objectives." 
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port  of  the  residual  equipment  function¬ 
ing  in  the  field. 

Phase  I  was  declared  a  success  in  April 
1997.  As  a  result,  the  Office  of  the  Secre¬ 
tary  of  Defense  leadership  decided  to  mi¬ 
grate  the  program  to  the  GCSS  and  to  have 
the  JOLT  manage  the  (Phase  I)  residual 
capabilities  through  fiscal  year  1997. 
DIS  A  will  serve  as  the  manager  for  tech¬ 
nical  aspects  of  the  GCSS  and  therefore 
will  certify  the  Phase  I  software  migrat¬ 
ing  to  GCSS. 

A  number  of  major  considerations  are 
involved  in  transfer  and  integration. 

Interoperability.  Phase  II  (JDST)  is  a 
joint  program.  Any  hardware  and  software 
selected  must  be  compliant  for  use  within 
the  GCSS  environment. 

Requirements  development.  During 
the  JL-ACTD,  the  CINCs  have  assisted 
in  the  requirements  refinement  process. 
The  Operational  Requirements  Document 
(ORD)  will  be  created  by  the  CINCs  and 
service  components  and  the  JOLT  and 
completed  as  a  part  of  the  transition  to  the 
GCSS  program. 

Utility  assessment.  An  assessment  of 
JDST  military  utility  will  be  conducted  by 
the  CINCs  (ACOM,  CENTCOM,  and 
EUCOM)  in  conjunction  with  support 
from  the  Operational  Test  and  Evaluation 

Command. 
Other  assess- 


"The  JL-ACTD  pro¬ 
gram  has  incorpo¬ 
rated  the  concepts  off 
evolutionary  acquisi¬ 
tion  streamlining 
and  reform  through¬ 
out  its  execution." 


ments,  as  re¬ 
quired,  will  be 
performed  by 
other  agencies. 
The  report  of 
acceptable  mili¬ 
tary  utility  will 


be  forwarded 


from  the  CINCs  through  the  Transition  In¬ 
tegration  Product  Team  (TIPT)  to  the  Un¬ 


der  Secretary  of  Defense  for  Acquisition 
and  Technology.  The  JOLT  also  will  re¬ 
ceive  copies  of  this  report. 

Security.  Upon  transition,  computer 
vendors  who  are  planning  new  computer 
products  that  feature  security  or  security- 
related  improvements  to  existing  products 
will  initiate  a  preliminary  evaluation. 
Technical  exchange  meetings  will  follow 
execution  of  nondisclosure  agreements 
between  all  parties.  The  Computer  Secu¬ 
rity  Center  will  advise  vendors  about  po¬ 
tential  security  strengths  and  weaknesses 
of  the  vendor  design  choices. 

Organization.  The  transition  plan  and 
details  of  execution  will  be  approved  by 
the  TIPT,  consisting  of  the  responsible 
Office  of  the  Secretary  of  Defense,  CINCs, 
Service  organizations,  and  agencies. 


Conclusion 


The  JL-ACTD  program  has  incorpo¬ 
rated  the  concepts  of  evolutionary  acqui¬ 
sition  streamlining  and  reform  throughout 
its  execution.  Specifically,  the  program: 

•  applied  an  evolutionary  product  devel¬ 
opment  and  acquisition  strategy  to  en¬ 
sure  that  final  products  provided  to 
CINCs  met  their  needs; 

•  used  an  open  systems  design  strategy 
to  permit  widest  possible  use  of  com¬ 
mercially  available  equipment  and 
software — 100%  of  the  hardware  com¬ 
ponents  and  80%  of  the  software  em¬ 
bedded  in  all  of  its  Phase  I  (LAD)  and 
Phase  II  (JDST)  devices  used  CANDI; 

•  conducted  joint  testing  of  equipment 
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with  the  operational  forces  and  the  JL- 
ACTD  product  development  teams; 
and 

•  made  provisions  for  Phase  I  products 
to  adapt  to  changing  requirements  de¬ 
rived  during  operational  activities. 

The  CINC  users  provided  positive  feed¬ 
back  during  this  program  as  a  result  of 
their  involvement  in  Phase  I’s  use  of  the 
evolutionary  acquisition  methodologies. 
The  JL-ACTD  executed  the  strategy  as 
follows: 

•  ‘Tools”  provided  through  Phase  I  en¬ 
hanced  the  existing  capability. 

•  Users  increased  their  sophistication 
using  the  demonstrated  capability, 
gained  insight,  and  asked  for  increased 
functionality. 

•  Tool  capabilities  were  then  increased 
to  meet  or  exceed  the  new  user  re¬ 
quests,  and  so  on. 

In  fact,  the  Phase  I  experience  indicated 
that  when  a  proper  capability  can  be  es¬ 
tablished  to  modify  product  configuration 
and  operation,  an  ultimate  tool  may  not 
be  established  because  the  most  useful  tool 
is  always  dependent  upon  the  sophistica¬ 
tion  of  the  user  base. 


But  acquiring  tools  (or  equipment)  is 
only  the  First  step.  Well  trained  and  moti¬ 
vated  people  are  also  required  to  get  maxi¬ 
mum  effect  from  their  use,  and  the  tools 
must  be  integrated  within  an  organization 
flexible  enough  or  so  structured  to  ensure 
both  efficient  and  effective  use.  It  is  the 
consensus  of  users  that  “value  can  be 
added”  through  the  demonstrated  Phase  I 
capabilities.  Not  only  has  the  Phase  I 
(LAD)  added  to  operational  capability,  but 
the  DoD  JL-ACTD  initiative  has  extended 
the  logistic  effort  and  provided  a  more 
comprehensive  overview  of  a  critical  as¬ 
pect  of  joint  and  combined  operations. 

In  search  of  an  explanation  for  Phase  I 
successes,  one  may  hypothesize  that  the 
use  of  modem  product  design  and  evolu¬ 
tionary  acquisition  methodologies  permit¬ 
ted  LAD  operators  to  assimilate  and  ma¬ 
nipulate  information  with  an  assortment 
of  efficiently  crafted  tools  to  arrive  at  spe¬ 
cific  operational  answers. 

The  key  to  success  is  access  to  infor¬ 
mation  sources  and  the  programmers’  abil¬ 
ity  to  resolve  problems.  Data  access  and 
programming  ability,  tracking  logistics 
assets,  and  providing  “what  is”  and  “what 
if’  in  advance,  is  the  key  to  both  Phase  II 
and  Phase  III  potential  that  can  be  dem¬ 
onstrated  real-time.  The  JL-ACTD  is  well 
on  its  way  to  developing  a  “precision  lo¬ 
gistics  unified  support”  (PLUS)  system. 

A  definite  PLUS  for  the  warfighter! 
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ACQUISITION  REVIEW  QUARTERLY 
GUIDELINES  FOR  CONTRIBUTORS 


The  Acquisition  Review  Quarterly 
(ARQ)  is  a  scholarly  peer-reviewed  jour¬ 
nal  published  by  the  Defense  Acquisition 
University.  All  submissions  receive  a 
masked  review  to  ensure  impartial  evalu¬ 
ation. 


Submissions 


Submissions  are  welcomed  from  any¬ 
one  involved  in  the  Defense  acquisition 
process.  Defense  acquisition  is  defined  as 
the  conceptualization,  initiation,  design, 
development,  test,  contracting,  produc¬ 
tion,  deployment,  logistic  support,  modi¬ 
fication,  and  disposal  of  weapons  and 
other  systems,  supplies,  or  services  to  sat¬ 
isfy  Defense  Department  needs,  or  in¬ 
tended  for  use  in  support  of  military  mis¬ 
sions. 


Research  Articles 


Manuscripts  should  reflect  research  or 
empirically-supported  experience  in  one 
or  more  of  the  aforementioned  areas  of 
acquisition.  Research  or  tutorial  articles 
should  not  exceed  4,500  words.  Opinion 
pieces  should  be  limited  to  1 ,500  words. 

We  publish  Defense  Acquisition  re¬ 
search  articles  that  involve  systemic  in¬ 


quiry  into  a  significant  research  question. 
The  article  must  produce  a  new  or  revised 
theory  of  interest  to  the  acquisition  com¬ 
munity.  You  must  use  a  reliable,  valid  in¬ 
strument  to  provide  your  measured  out¬ 
comes. 


Manuscript  Sections 


The  introduction  should  state  the  pur¬ 
pose  of  the  article  and  concisely  summa¬ 
rize  the  rationale  for  the  undertaking. 

The  methods  section  should  include  a 
detailed  methodology  that  clearly  de¬ 
scribes  work  performed.  Although  it  is 
appropriate  to  refer  to  previous  publica¬ 
tions  in  this  section,  the  author  should  pro¬ 
vide  enough  information  so  that  the  expe¬ 
rienced  reader  need  not  read  earlier  works 
to  gain  understanding  of  the  methodology. 

The  results  section  should  concisely 
summarize  findings  of  the  research  and 
follow  the  train  of  thought  established  in 
the  methods  section.  This  section  should 
not  refer  to  previous  publications,  but 
should  be  devoted  solely  to  the  current 
findings  of  the  author. 

The  discussion  section  should  empha¬ 
size  the  major  findings  of  the  study  and 
its  significance.  Information  presented  in 
the  aforementioned  sections  should  not  be 
repeated. 
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Research  Considerations 


Contributors  should  also  consider  the 
following  questions  in  reviewing  their  re- 
search-based  articles  prior  to  submission: 

•  Is  the  research  question  significant? 

•  Are  research  instruments  reliable  and 
valid? 

•  Are  outcomes  measured  in  a  way 
clearly  related  to  the  variables  under 
study? 

•  Does  the  research  design  fully  and  un¬ 
ambiguously  test  the  hypothesis? 

•  Did  you  build  needed  controls  into  the 
study? 

Contributors  of  research-based  submis¬ 
sions  are  also  reminded  they  should  share 
any  materials  and  methodology  necessary 
to  verify  their  conclusions. 

Criteria  for  Tutorials 


Tutorials  should  provide  special  in- 
struction  or  knowledge  relevant  to  an  area 
of  defense  acquisition  to  inform  the  De¬ 
fense  Acquisition  Workforce. 

Topics  for  submissions  should  rely  on 
or  be  derived  from  observation  or  experi¬ 
ment,  rather  than  theory.  The  submission 
should  provide  knowledge  in  a  particular 
area  for  a  particular  purpose. 


Opinion  Criteria 


Opinion  articles  should  reflect  judg¬ 
ments  based  on  the  special  knowledge  of 
the  expert.  Opinion  articles  should  be 
based  on  observable  phenomena  and  pre¬ 
sented  in  a  factual  manner;  that  is,  sub¬ 
missions  should  imply  detachment.  The 
observation  and  judgment  should  not  re¬ 
flect  the  author’s  personal  feelings  or 
thoughts.  Nevertheless,  opinion  pieces 
should  clearly  express  a  fresh  point  of 
view,  rather  than  negatively  criticize  the 
view  of  another  previous  author. 

Manuscript  Style 


We  will  require  you  to  recast  your  last 
version  of  the  manuscript,  especially  ci¬ 
tations  (e.g.,  footnotes  or  endnotes)  into 
the  format  required  in  two  specific  style 
manuals.  The  ARQ  follows  the  author 
(date)  form  of  citation.  We  expect  you  to 
use  the  Publication  Manual  of  the  Ameri¬ 
can  Psychological  Association  (4th  Edi¬ 
tion),  and  the  Chicago  Manual  of  Style 
(14th  Edition).  The  ARQ  follows  the  au¬ 
thor  (date)  form  of  citation. 

Contributors  are  encouraged  to  seek  the 
advice  of  a  reference  librarian  in  complet¬ 
ing  citations  of  government  documents. 
Standard  formulas  of  citations  may  give 
only  incomplete  information  in  reference 
to  government  works.  Helpful  guidance 
is  also  available  in  Gamer,  D.L.  and  Smith, 
D.H.,  1993,  The  Complete  Guide  to  Cit¬ 
ing  Government  Documents:  A  Manual 
for  Writers  and  Librarians  (Rev.  Ed.), 
Bethesda,  MD:  Congressional  Informa¬ 
tion  Service,  Inc. 
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Copyright  Information 


The  ARQ  is  a  publication  of  the  United 
States  Government  and  as  such  is  not 
copyrighted.  Contributors  of  copyrighted 
works  and  copyright  holders  of  works  for 
hire  are  strongly  encouraged  to  request 
that  a  copyright  notification  be  placed  on 
their  published  work  as  a  safeguard  against 
unintentional  infringement.  The  work  of 
federal  employees  undertaken  as  part  of 
their  official  duties  is  not  subject  to  copy¬ 
right. 

In  citing  the  work  of  others,  it  is  the 
contributor’s  responsibility  to  obtain  per¬ 
mission  from  a  copyright  holder  if  the  pro¬ 
posed  use  exceeds  the  fair  use  provisions 
of  the  law  (see  U.S.  Government  Printing 
Office,  1994,  Circular  92:  Copyright  Law 
of  the  United  States  of  America,  p.  15, 
Washington,  DC:  Author).  Contributors 
will  be  required  to  submit  a  copy  of  the 
written  permission  to  the  editor  before 
publication. 


Manuscript  Format 


Pages  should  be  double-spaced  and  or¬ 
ganized  in  the  following  order:  title  page, 
abstract,  body,  reference  list,  author’s  note 
(if  any),  and  figures  or  tables.  To  ensure 
anonymity,  each  paper  should  be  submit¬ 
ted  with  a  separate  page  that  includes  the 
author(s)’s  name(s)  and  complete  address, 
and  the  paper  should  include  the  title,  ab¬ 
stract,  keywords,  body,  complete  set  of 
references,  along  with  tables  and  figures 
at  the  end.  Authors  are  reminded  not  to 
refer  to  themselves  or  to  their  own  work 
directly  in  the  paper.  Figures  or  tables 
should  not  be  inserted  (or  embedded,  etc.) 


into  the  text,  but  segregated  one  to  a  page 
following  the  text.  Articles  must  be  print¬ 
able  within  one  issue  and  should  not  ex¬ 
ceed  4,500  words  for  research  or  tutorials 
and  1,500  words  for  opinion  pieces;  ar¬ 
ticles  will  not  be  printed  in  parts  or  in  a 
continuing  series.  If  material  is  submitted 
on  a  computer  diskette,  each  figure  or  table 
should  be  recorded  in  a  separate,  export¬ 
able  file  (i.e.,  a  readable  .eps  file).  For 
additional  information  on  the  preparation 
of  figures  or  tables,  see  CBE  Scientific 
Illustration  Committee,  1988,  Illustrating 
Science:  Standards  for  Publication, 
Bethesda,  MD:  Council  of  Biology  Edi¬ 
tors,  Inc.  Please  restructure  briefing  charts 
and  slides  to  a  look  similar  to  those  in  pre¬ 
vious  issues  of  ARQ. 

The  author  (or  corresponding  author  in 
the  case  of  multiple  authorship)  should 
attach  to  the  manuscript  a  signed  cover 
letter  that  provides  the  author’s  name,  ad¬ 
dress,  and  telephone  number  (fax  and 
Internet  addresses  are  also  appreciated). 
The  letter  should  verify  that  the  submis¬ 
sion  is  an  original  product  of  the  author; 
that  it  has  not  been  published  before;  and 
that  it  is  not  under  consideration  by  an¬ 
other  publication.  Details  about  the  manu¬ 
script  should  also  be  included  in  this  let¬ 
ter:  for  example,  its  title,  word  length,  the 
need  for  copyright  notification,  the  iden¬ 
tification  of  copyrighted  material  for 
which  permission  must  be  obtained,  a  de¬ 
scription  of  the  computer  application  pro¬ 
grams  and  file  names  used  on  enclosed 
diskettes,  etc. 

The  letter,  one  copy  of  the  printed 
manuscript,  and  any  diskettes  should  be 
sturdily  packaged  and  mailed  to:  Defense 
Systems  Management  College,  Attn: 
DSMC  Press  (ARQ),  9820  Belvoir  Road, 
Suite  3,  Fort  Belvoir,  VA  22060-5565. 
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In  most  cases,  the  author  will  be  noti¬ 
fied  that  the  submission  has  been  received 
within  48  hours  of  its  arrival.  Following 
an  initial  review,  submissions  will  be  re¬ 
ferred  to  referees  and  subsequent  consid¬ 
eration  by  the  ARQ  Editorial  Board. 


Contributors  may  direct  their  questions 
to  the  Editor,  ARQ ,  at  the  address  shown 
above,  by  calling  (703)  805-4290  (fax 
805-  2917),  or  via  the  Internet  at: 
gonzalezd  @  dsmc.dsm.mil. 

The  DSMC  Home  Page  can  be  accessed 
at: 

http://www.dsmc.dsm.mil. 
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